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Sampling is an indispensable operation in signal processing and digital communications. 
The conventional approach of collecting samples of an analog signal is uniform sampling, 
which collects samples at equal intervals. The uniform sampling approach is not always 
the best in terms of the number of samples required for the same reconstruction error, 
therefore, the possibility of collecting samples of an analog signal at nonuniform intervals 
has to be explored. Given any signal, what is the best way to take the samples or at what 
intervals the samples are to be taken so that the whole process is efficient (requires least 
number of samples to represent an analog signal for a given error and a given reconstruction 
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method), is the basic problem of nonuniform sampling. The objective of this thesis is to 
make some contributions towards the above described problem of nonuniform sampling. 

The uniform sampling is based on Shannon’s sampling theorem. In uniform sampling the 
signal is sampled at a rate greater or equal to the twice the bandwidth of the signal. This 
technique is not suitable in the following cases- (a) When the signal is not band-limited, 
(b) When an estimate of the bandwidth of the signal is not available. It is for these 
cases that nonuniform sampling can serve as an alternative. The time-limited signals are 
not hand-limited and so uniform sampling is not applicable in this case. Moreover, 
signals found in practice are always time-limited, therefore, the time-limited class of signals 
is important; and hence, in this thesis, nonuniform sampling techniques for time-limited 
signals are developed. 

In this thesis, two nonuniform sampling problems for time-limited signals have been formu- 
lated and algorithms which provide solutions to these problems are presented. Given any 
time-limited signal, what is the nonuniform placement of a finite number of samples in the 
domain of the signal such that the fractional mean square reconstruction error is minimised? 
This is the first problem that is attempted in this thesis. The basic drawback of the type of 
nonuniform sampling strategy that results from solving this problem is, that it requires the 
storage of the sampling instants as well. Therefore, another nonuniform sampling problem 
is proposed. Given a time-limited signal, what is the optimal distribution of a finite number 
of samples in the partitions of a time-limited signal? The optimality criterion is to minimise 
the fractional mean square reconstruction error. In this problem, in each of the partitions 
the samples are placed uniformly. Further, the reconstruction error minimisation has to 
be performed with respect to the partition lengths as well. It is more efficient in terms of 
the storage requirements, to sample uniformly in the different partitions at dissimilar rates 
rather than sampling completely nonuniformly, as in the case of the first problem. Because, 
in this scheme only the instant of the first sample in each of the partition, the partition 
length and the number of samples in the partition have to be noted down. 

To solve both these problems, the excellent time-scale localisation properties of wavelet 
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transform have been used. Therefore, in this thesis, before presenting the solution to 
these problems, the wavelet transforms are discussed; further a novel concept, termed as 
scale-limitedness is introduced with reference to continuous wavelet transforms. 

The wavelet transform of a signal is the inner product between the signal and the function 
° parameter, and the shift parameter, denoted by h, shifts 

the wavelet to t = h, therefore, the wavelet transform gives the behaviour of the signal at 
t = h. At lower scales the wavelet transform gives the fast varying component present in the 
signal. Therefore, the wavelet transform is enhanced at lower scales, in regions, wherein, 
the signal is varying fast. This has been illustrated through simulations. 

The concept of scale-limitedness, introduced in this thesis, can be used for quantifying 
signal variations. A signal is called scale-limited, if its wavelet transform is zero for all 
scales below a certain scale value and for all shifts. Another definition, termed as (Jo- 
practical scale-limitedness is also introduced. A signal is called (5o-practically scale-limited 
to ai, if a/ is the largest scale value below which the fraction of the energy, for all shifts, is 
less than (Jq- Next some examples are presented, in which the signals are plotted and their 
(5o-scaie-limits are computed. It can be inferred from these examples, that the signals which 
have faster varying component have smaller scale-limits. Further, eliminating fast varying 
components, it is possible to construct signals which are scale-limited. 

Next we discuss the relation between the higher order vanishing moment property and 
scale-limitedness. Any real square integrable function qualifies as a wavelet if its zeroth 
moment vanishes; there exist wavelets for which the higher order moments vanish. It has 
been shown that, signals which are slower varying have relatively larger scale-limits because 
of the vanishing moment property of the wavelet. A few theorems have been stated and 
proved next. It has been shown that, a signal which is band-limited is also scale-limited. 
Moreover, it has been proved that there exist time-limited signals which are scale-limited 
and obviously, not band-limited. Further it is shown that, signals which have smaller scale- 
limits have larger upper bound on their differentials. Next it is shown that the Lagrangian 
interpolation function is Jo-practically scale-limited. Finally it is shown that, signals which 
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are in the successive approximation spaces associated with the multiresolution analysis, are 
scale-limited. 


As an application of scale-limitedness, a sampling rate estimation method for signals is 
proposed. For estimating the sampling rate, a theorem is proved, which states that signals 
with smaller scale-limits should be sampled at a relatively faster rate for the same error 
bound. This method proceeds by, first over sampling the signal, then finding the scale-limit 
using the multiresolution analysis. And finally, given a bound on the error, reduction in the 
number of samples is found such that the error remains less than the bound. The method 

gives a sampling rate reduction of a multiple of where j is an integer greater than or 
equal to zero. 


The first nonuniform sampling problem is the optimal sample placement problem. Given 
any time-limited srgnal, what is the nonuniform placement of a finite number of samples 
in the domain of the signal such that the fractional mean square reconstruction error is 
minimised? The sampling algorithm developed here is based on the observation that if 
the error in the transform domain is bounded, then the error in the time domain is also 
bounded. Theorems have been presented, which give the bounds on the fractional mean 
square error. It can be inferred from these theorems, that the bound on the fractional 
mean square error is more sensitive to the value of the fractional mean square error in the 
transform domain at lower scales as compared to that at higher scales. Therefore, to make 
the fractional mean square error smaller, the error in the transform domain should be made 
relatively smaller at lower scales. Another observation is that, the mean square error in 
the transform domain can be made small by placing the samples at those points in the 
transform domain, at which the wavelet transform maxima occur. 


e algorithm for solving this problem proceeds by first sampling the signal at the highest 
possible mte. Then the samples are picked in the time domain at a value denoted by f„ if 

set IT'"' '' do'fain at This gives the initial 

t of samp es, if all the maxima are exhausted and still samples can be taken then rest 

of the samples are taken in the neighbourhood of the samples in the initial set. Using the 
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optimal samples the original set of samples is reconstructed using an interpolation method. 
It is assumed that the interpolation is done using local functions shifted to the sample 
value. Further, the interpolation method should be such that, at the known values of the 
signal the interpolated value should be same as the known value. Simulation results which 
demonstrate the algorithm have been presented. 

The second nonuniform sampling problem attempted in the thesis is the following- Given 
a time-limited signal, what is the optimal distribution of a finite number of samples in the 
partitions of a time-limited signal such that the fractional mean square error is minimum? 
In each of the regions, uniform sampling is done. The regions are obtained by partitioning 
the signal depending upon local variations. In the sampling strategy, proposed here, the rate 
of sampling adapts to local variations. In the algorithm, first the signal is partitioned into 
dissimilar regions. Each of the regions is characterised by a scale-limit, which is distinct from 
the values of the scale-limits of the neighbouring regions. Then, in each region the optimal 
number of samples are distributed, which is a fraction of the total number of samples to be 
distributed. It has been proved in the thesis, that segments with smaller scale-limits should 
be sampled at a higher sampling rate. In each of the regions the uniform sampling is done. 
Therefore the solution to the second problem leads to a multirate sampling strategy. 

The algorithm proposed for multirate sampling is as follows. First a low value of the 
threshold is set, then the optimal sample distribution is found; using this optimal distribution 
the signal is sampled uniformly in the different segments. Next these samples are used to 
reconstruct the signal back and finally the fractional mean square error is found. This 
is repeated for successively higher values of the threshold and that sample distribution is 
selected, for which, the minimum fractional mean square error is obtained. The fractional 
mean square error versus the threshold value is found to have many local minima, therefore, 
the global minimum has to be selected. The simulation results also have been presented. 
The main conclusion is that, in order to keep the bound on the fractional mean square error 
low, the number of samples in any segment should be inversely proportional to a positive 
power of the scale-limit. 
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To summarise, in this thesis, two nonuniform sampling problems have been formulated 
Given any time-limited signal what is the placement of a finite number of samples such 
that the fractional mean square error is minimum? It has been proved, that in order to 
minimise the fractional mean square reconstruction error, the samples should be placed at 
and in the neighbourhood of those points at which the wavelet transform maxima occur 
and also more samples should be placed using the information of the maxima at the lower 
scales. An algorithm for nonuniform sampling has also been presented. Given any time- 
limited signal, how to partition the signal into regions of dissimilar variation and what is the 
rate of sampling in each region, when uniform sampling is done in each region? This is the 
second problem attempted m this thesis. This problem has been solved by partitioning the 
signal into regions of dissimilar variation using the concept of scale-limitedness introduced 
with reference to the continuous wavelet transforms. The signals have been partitioned 
into regions such that each region has a scale-limit which is different from the scale-limits 
of the neighbouring regions. It has been established in this thesis, that the error bound is 
minimised when more samples fall in the regions of smaller scale-limits. 

Conclusions based on the results obtained in the present work are given below- 

• In regions of time domain, wherein, the wavelet transform gets enhanced at lower 

scales, the signal is faster varying as compared to regions where signal is slower 
varying. 

• Signals which are faster varying, have relatively smaller scale-limits. 

• Scale-limited signals satisfy the following properties- 

- Signals which are band-limited are also scale-limited. 

There exist time-limited signals which are scale-limited as well. 

- Signals having smaller scale- 1 irr, its have larger upper bounds on their differentials. 

- The Lagrangian interpolating function is 5o-practically scale-limited. 

Signals which are in successive approximation spaces associated with multires- 
olution analysis are scale-limited. 
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. It has been shown that, for the same error performance, the signals with smalle, 
scale-limits should be sampled at a higher rate. 

. For placing the samples nonuniformly, in order to keep the mean square error low, 
the strategy of sampling is to place the samples at and in the neighbourhood of the 
maxima of the wavelet transform. 

. For region based sampling, when samples are placed uniformly in each of the regions 
at different rates, more samples should fall in regions of smaller scale-limits. 
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Chapter 1 


Introduction 


This thesis deals with the problem of nonuniform sampling. The problem consists of 
finding an optimal algorithm for nonuniformly sampling a signal so that the samples 
can be used to reconstruct back the original signal. Nonuniform sampling can be 
classified into two categories. Firstly nonuniform sampling of signals on the whole of 
real line, and secondly, nonuniform sampling of time-limited signals. Here the problem 
of nonuniform sampling of time-limited signals is dealt with and optimal solutions are 
provided. 


1.1 Motivation 

Sampling is an indispensable operation in signal processing and digital communications. 
Modern digital computers can deal only with a finite set of numbers and there is no 
possibility of operation on analog signals. Although there are analog computers which 
operate upon analog signals, due to practical constraints like- difficulty in implementing 
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all types of operations, low speeds, problem in storing the results and application 
specific nature of the computer (for different applications different computers have to 
be designed), they have not become popular. In contrast, the digital computers do 
not have the above mentioned difficulties but they cannot operate on analog signals 
directly. Therefore, the analog signals have to be sampled and then only the discrete 
set of numbers, which represent the amplitude of the signal at different points of space 
and time, can be processed using the digital computers. 

The following are some important questions which one comes across while dealing with 
sampling. 

• What should be the rate of sampling? 

• What is the sample placement strategy? 

• How to reconstruct a signal from its samples? 

The answers to these questions are dependent on the characteristics of the signal being 
sampled. Generally the samples are placed uniformly, which leads to uniform sampling. 
This technique was formally introduced by Shannon [Sha49]. Shannon based his argu- 
ments on Whittekar-Kotelnikov theorem and proposed his technique for band-limited 
signals. Once it is decided that the samples be placed uniformly, the only problem 
left is to find the rate of sampling required. The W-K theorem, which is now known 
as S-W-K theorem states, that for a signal band-limited to [-W, W] a rate of 2W 
samples per second is sufficient to reconstruct the signal back from the samples. 

The uniform sampling has become very popular in signal processing mainly due to the 
following reasons. 
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• Easy to implement. 

• Simplicity in the processing of uniform samples. 

In the case of uniform sampling, the only requirement is that the signal bandwidth be 
known apriori. In practice, however, for many cases this does not pose any problems 
because an antialiasing filter (AAF) is used as the preprocessing unit to band-limit the 
incoming signal. Then the rate of sampling is decided according to the bandwidth of the 
AAF. The bandwidth of the AAF has to be selected judiciously. Very small bandwidth 
of the AAF, although leads to lower sampling rate, in the process, may lead to loss of 
vital information related to the signal. Alternatively, larger bandwidth of AAF leads 
to larger sampling rate, which in turn leads to redundancy in the representation and 
at the same time leads to higher computational costs. 

An alternative approach to uniform sampling is to have nonuniform sampling. In 
nonuniform sampling, the samples are placed at unequal spacings. Since the restric- 
tion that samples be placed uniformly is removed, the need to develop optimal sampling 
strategy arises. A general nonuniform sampling problem is one in which a finite dura- 
tion signal is given and the optimal placement of a finite number of samples has to be 
found. The strategy adopted in nonuniform sampling is to analyse the incoming signal 
and place more samples in regions of faster variation. 

Consider the case in which a finite duration signal has to be sampled at a finite number 
of points. The best criterion for deciding the position of the samples is to minimise 
the error between the original signal and the reconstructed signal using the samples 
with respect to the sample positions. But there are drawbacks to the above mentioned 
method. To reach the optimum may be difficult. Another problem is that the method 
does not explain why more samples get placed in certain regions. 
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In this thesis, an algorithm for optimal nonuniform sampling is proposed. Further, 
using a new signal variation measure, which is well suited for finite duration signals, a 
region based sampling strategy has been proposed. These strategies avoid the exhaus- 
tive search for an optimal sample placement. 


1.2 The Nonuniform Sampling Problems 

Here two problems have been formulated and solved, namely, sample number distribu- 
tion problem and sample placement problem. 

The Sample Placement Problem 

Given a finite duration signal, what is the nonuniform placement of a finite number 
of samples in the domain of the signal such that the fractional mean square error is 
minimised? To solve this problem, the wavelet transform description of the signal 
has been used. It has been shown that if the interpolation is done using functions 
which are shifted to sample point and multiplied by the sample value and further 
these functions are local (Most of the energy is concentrated around the origin.), then, 
the samples should fall in the same regions, in which, the wavelet transform values 
are relatively large in the domain of the shift parameter. Another constraint on the 
sample point is that sampling instant should be in the domain of the original signal. 
Using the above mentioned properties of the optimal sampling instants, an algorithm 
for optimal sampling has been proposed. The basic drawback of the type of nonuniform 
sampling strategy, that results from solving this problem is, that it requires the storage 
of the sampling instants as well. Therefore, another nonuniform sampling problem is 
proposed. 


1.2 The Nonuniform Sampling Problems 
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The Sample Number Distribution Problem 

Given any time-limited signal, what is the optimal distribution of a finite number of 
samples in the partitions of the signal? The problem is solved by segmenting the signal 
into regions of different variations and distributing the samples in the regions in an 
optimal fashion. In each of the regions, however, the samples are placed uniformly. 
To solve the problem a multirate sampling strategy for time-limited signals has been 
developed. 

This problem has two aspects: the first aspect is to segment the signal into different 
regions such that the variations of the signal remains same throughout a region, while 
the second aspect is to decide the rate of sampling in each of the regions. 

The problem of segmentation has been solved using a signa.1 variation measure which is 
defined with reference to wavelet transforms. Further a theorem has been established 
which proves that relatively more samples should fall in regions of faster variation in 
order to minimise the error between the original signal and the reconstructed signal 
using the samples. 

The reason for formulating this problem is, that in the case of sample placement all 
the sampling instants have to be stored which would require a lot of storage space. 
But the solution to the second problem leads to an algorithm, in which, the starting 
instant of a partition, the partition length and the number of samples in the partition 
only have to be noted down, to locate all the samples. 
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1.3 Strategies for Solving the Problems 


For solving the sample placement problem, it is shown that the maxima of the wavelet 
transform at different scales have to be taken into consideration for deciding the optimal 
placement of the samples. Further, it can be inferred from the theorems, that more 
samples should be distributed using the information at lower scales. Using these results, 
an algorithm for sample placement has been presented. This algorithm assumes certain 
specific properties of the interpolation method used. Simulation results have also been 
presented. For solving the two distinct problems- the sample number distribution 
problem and the sample placement problem, the time-scale localisation properties of 
the wavelet transforms are exploited. 

?or solving the sample number distribution problem, a measure called scale-limitedness 
vith reference to wavelet transforms, is introduced and utilised. The wavelet transform 
)f a signal is an inner product between the signal and shifted and scaled versions of 
ertain functions known as wavelets. Wavelets are finite energy functions with good 
iecay properties. 

.et a wavelet be denoted by then ^ is the scaled version of the wavelet. A 
lift also can be introduced and the modified wavelet is given by It can 

e observed, that at relatively lower scales, the support of the wavelet reduces. The 
ipport of the wavelet is the subset of the domain in which it has significant energy, 
herefore, it can be concluded that, at low scales, the wavelet transform gives the 
ihaviour of the signal at and around t = b. This has significance because, using 
ivelet transformed domain description of a signal, it is possible to get important 
orrr ation about the local behaviour of a signal. A signal is said to be scale-limited, 
ts ti^velet transform is zero for all scales below certain value and for all shifts. This 
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value is called the scale-limit of the signal. 

Using the concept of scale-limitedness, the given signal is segmented into disjoint re- 
gions, where each region is characterised by its own scale-limit. After segmenting the 
signal, for which an algorithm is provided, the only problem left out is to decide the 
sampling rate in each of the segments. Theorems have been stated and proved, which 
establish that regions wherein the scale-limit is low, the sampling rate should be rela- 
tively high, in order to keep the overall reconstruction error low, if the total number 
of samples that have to be distributed is fixed. Simulation results using various test 
signals have been presented. 


1.4 Organisation of the Thesis 


In Chapter 2, literature related to sampling theory has been reviewed. Mainly the 
focus is on nonuniform sampling. 

Since the solution of the problems formulated in the thesis require certain time-scale lo- 
calisation properties of the wavelet transform, therefore, before presenting the nonuni- 
form sampling problems and their solution the wavelet transform is discussed. In 
Chapter 3, scale-limitedness is introduced with reference to wavelet transforms. A 
signal is called scale-limited if the wavelet transform is zero for all ^'alues of the scale 
below a certain value and for all shifts. The practical considerations due to which this 
concept has emerged have also been discussed. It has been shown through simulations 
that signals with smaller scale-limits have faster variation. 

Scale-limitedness is similar to band-limitedness, but has some additional properties 
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which makes it very useful. As an extension (Jo-practical scale-limitedness has been 
defined. Finally, a few properties of scale-limited signals have been established. It is 
shown that all band-limited signals are scale-limited with respect to a class of wavelet 
families. Further, the existence of time-limited signals which are also scale-limited is 
established. Moreover, it is proved that, the larger the value of the scale-limit, the 
smoother is the signal. The class M" is defined and it is shown that the Lagrangian 
interpolation for ‘n’ points is (Jo-practically scale-limited with respect to a wavelet 
family whose mother wavelet is in M" space. 

In the same chapter, as an application of scale-limitedness, an algorithm for estimating 
the required sampling rate for any signal, for a given error performance is proposed; an 
expansion in terms of the samples is also presented. Scale-limitedness with reference 
to wavelet transforms is used as the measure of variation. The proposed algorithm 
proceeds by sampling the signal initially at a high rate, then recursively subsampling 
depending upon the required error performance. 

In Chapter 4, the optimal sample placement problem is formulated. Theorems have 
been provided which serve as guidelines for optimal sample placement. .A.n algorithm 
for sample placement has been provided. Simulation results have also been presented. 

In Chapter 5, the sample number distribution has been formulated. The solution to the 
problem leads to a multirate sampling strategy for time-limited signals. The sampling 
strateg}' is based on the local variations. The strategy proceeds by segmenting the 
signal using the wavelet transformed domain description. Further, sampling in each 
segment is done depending upon the scale-limits of the partitions. 

In the final and the sixth chapter, summary of the work carried out in the thesis, the 
conclusions and recommendations for future work are also given. 


Chapter 2 


Nonuniform Sampling: A Review 


In this chapter, the literature related to sampling theory is reviewed. The main empha- 
sis will be on nonuniform sampling. The whole chapter is organised into two sections, 
namely- uniform sampling and nonuniform sampling. 

Traditionally signals have been subjected to uniform sampling, the reasons have been 
listed out in Chapter 1. These are- it is easy to obtain uniform samples; processing of 
uniform samples is easy and efficient techniques can be developed. 

Intuitively, however, the nonuniform sampling appears to be the natural and rational 
way of discrete representation of a continuous signal. Because if the relatively faster 
varying portions of a signal are sampled at a higher rate then the samples would give 
a better representation of the original signal (in terms of lesser reconstruction error) . 
Likewise, a signal might require lesser number of samples to represent it, if sampled 
nonuniformly, compared to uniform sampling, for the same error performance. Con- 
sequently, the nonuniform sampling can lead to economy in the storage space require- 
ments and lower processing time. Moreover, lower amount of data would mean faster 
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communication or lower bandwidth for digital transmission. 

These observations have led to certain interesting applications of nonuniform sampling, 
such as, ECG data compression [SA94] and nonuniform tapped delay lines [Yen57]. 
Another area of application is the error correcting codes, where over sampling and 
discarding the erased or erroneous samples is a potential alternative to error correcting 
codes [Mar90]. 

Further nonuniform reconstruction techniques are also important in the demodulation 
of frequency modulated [RGWW77], phase and pulse modulated [Kon89] and delta 
modulated signals [Gam89]. The problem of processing nonuniform samples also occurs 
in the context of astronomy [Mie79], [Pon] and in geophysical sciences [Stu83]. 

Other areas where nonuniform sampling occurs are: Computer assisted tomography 
[Sou88], [Sou89], Nuclear magnetic resonance [YS87], calibration of large space-borne 
antennas [RSC87] and very long-baseline interferometers [JJCL85]. There are certain 
reasons due to which the nonuniform sampling has not become popular. The main 
reasons are as follows- 


• There are no efficient techniques for nonuniform sampling. 


• Not much work is done in the field of processing the nonuniform samples. 


Next we review the uniform sampling. 
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2.1 Uniform Sampling 

The purpose of sampling is to represent an analog signal by a discrete sequence of its 
samples. In this context, the Shannon’s sampling theorem specifies the lowest rate of 
sampling required to reproduce the original signal. 

Definition 2.1.1 Shannon’s sampling theorem: A band-limited signal of finite energy 
which has no frequency components higher than W hertz, is completely described by 
specifying the values of the signal at instants of time separated byl/2W seconds [ShafQj. 
The interpolation formula is given by 

OO 

dii) — 'Yl g{T) siniflixWt — mT)/{27tWt — nr), (2.1) 

n=— OO 

where g{t) is band-limited to [—W, W] and T = 

This implies that any signal band-limited to [—W, W] can be represented in terms of 
its samples taken at rate of 2W samples per second. 

2.1.1 Error Analysis in Sampling Representation 

In this section, the errors that arise in the practical implementation of the Shannon’s 
theorem are discussed. Due to the practical limitations in the implementation of the 
sampling theorem, the following types of errors can arise in the reconstruction of the 
original signal - 

• Truncation error - When a finite number of samples are used to reconstruct the 
signal then the error that arises is called Truncation error. 
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• Aliasing error - This error arises when the sampling rate is less than the rate 
specified by the sampling theorem. 

• Jitter error - This occurs due to the violation of the sampling instants from the 
uniform sampling points. 

• Amplitude or round off error - This error occurs as a result of the uncertainty in 
measuring the amplitude of the sample values. 

A comprehensive treatment of the errors have been presented by Thomas and Liu 
[TL64] and Popoulis [Pou68], [Pou66]. 


2. 1.1.1 The Truncation Error and its Bounds: 


In this section, we will be discussing the truncation error bounds on a band-limited 
signal. The signal to be reconstructed using its uniform samples is denoted by g{t) and 
it is band-limited to [—W, W]. The truncation error can be defined by the following 
partial sum 


^T(t) = 9{nT)sinc(^ - n). (2.2) 

|n|>yv ^ 

Where T is the interval between two consecutive samples, T = ^ and g{nT) are the 
sample values at the time nT for n taking values on the integer set. Tsybako and 
Iakovlev [TI59] have given the following truncation error bound- 


mt)\ < 


^2 -Kt 
— szn-:- 

TT ' 6t 



Where E is the energy of the signal, -T <t< T and St < fL. 


(2.3) 


2.1 Uniform Sampling 


13 


Helms and Thomas [HT62] gave the following bound- 

4M 




(2.4) 


7r2iV(l-r)' 

Here g{t) is band-limited to rW < W, where 0 < r < 1 and M = max |^(i)|. A 
similar bound was given by Jordan [JorSl] 

4M\sin(2TrWt)\ 


- 7rA^(l - r) ■ 

If the g(t) is approximated by the asymmetrical partial sum- 

/(r4W2 f n \ sin(2W'K — nrr) 
9Ni, Niit) = ^ 9 [7 

n=K-Ni 


\2WJ (2WTT-nn) 


then the truncation error is also shown to be bounded by, 




2M 


7r^(l — r) 




-b 


^2, 


(2.5) 


( 2 . 6 ) 


(2.7) 


Many other bounds have been given by various researchers [deF67], [RB72]. 


2. 1.1. 2 The Aliasing Error and its Bounds: 

This type of error results when a band-limited signal is sampled at a lower rate than 
that specified by the Nyquist theorem. The aliasing error is given by 

^A{t) = 9{t)-9s{t)' 

Where g{t) is the original signal and gs(t) is the result of applying the sampling theorem 
representation with samples taken at rate of 2VI samples per second, when the signal is 
not necessarily band-limited to [—W, W]. Weiss [WeiSS] considered the aliasing error 
when the value of G{f) differs from zero for |/| > W, The function G{}) has the 
following properties G{f) € L^(— oo, oo), G{f) = C^C/), G{f) is of bounded variation 
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and 2G{f) = G{f + 0) + G{f-0). Let g^it) be the reconstruction using the samples at 
a rate of 2W samples per second and the interpolation in 2.1. Weiss gave the following 
upper bound- 

^Ait) = \9{t)-9s{t)l 

<- 

Several other bounds are available in literature [Pou66], [JLB67], [Sta67], [Sti67]. 


2. 1.1. 3 The Jitter and Round ofif Errors: 


The Jitter error occurs due to the uncertainty in the sampling instants. If the signal 
has to be sampled at nT, then due to practical limitations (finite accuracy of the 
instruments), the actual sampling instants turn out to be t„ = nT + jn, where 7 „ 
is randomly chosen. The Jitter and Round off errors are similar and require similar 
treatment[TL64]. 


Popoulis [Pou66] has found the bound for the round off error for a signal which is 
band-limited to [—Wi, Wi\. He proposed the following general expansion- 


9{'t) = Y.9{nT) 

— CX5 


sin{WQ{t — nT)) 
W 2 (t - nT) 


( 2 . 8 ) 


where, W 2 — (f) > Wi, Wi < Wq < 2 W 2 — Wi. Using this cardinal series with 
Wo = Wi and the actual recorded or sampled values he constructed tlie function gr{t), 
which differs from g(t) by the total round-off error Sr(t). He showed that the error 
£r{t) is bounded by its own total energy: that is. 


Er 


Kit)\ < 


71 


(2.9) 



2.2 Nonuniform Sampling 


15 


where, 



( 2 . 10 ) 


For the error free reconstruction of band-limited signal from its jittered samples, Hig- 
gins [Hig76] has presented two series representations. Beutler [Beu61], [Beu66] has 
presented the basic theoretical treatment of the problem. 


2.2 Nonuniform Sampling 

When sampling is done on the set {tjt}, where t^s are not necessarily kTs, where k is 
an integer and T is a real quantity whose value is equal to the interval of sampling, 
then the sampling is called nonuniform sampling. The nonuniform sampling will be 
discussed under two subsections, namely- 

• Nonuniform sampling of signals on R: 

• Nonuniform sampling of time- limited signals: 


2.2.1 Nonuniform Sampling of Signals on R 

Band-limited as well as nonband-limited signals can be subjected to nonuniform sam- 
pling. But so far research has been mainly concentrated on studying nonuniform sam- 
pling of band-limited signals. In the case of nonuniform sampling, arbitrary sampling 
of a band-limited signal at the Nyquist rate, does not ensure that the signal can be 
uniquelj- reconstructed from the samples. This fact can be observed from the following 
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example. Suppose a band-limited signal is sampled at the Nyquist rate at sampling 
instants {tk}. Suppose that it is possible to to interpolate a band-limited signal with 
zero crossings at the points {tk}. If the interpolated signal is added to the original 
signal, then another signal is obtained, which has the same bandwidth as the original 
signal and moreover it has the same sample values at the instants {tk}- Therefore the 
samples taken at the instants {tk} do not uniquely represent the original signal. In 
other words, it is not possible to interpolate the original signal form the samples taken 
at such {tk}. The set of samples which provide unique reconstruction is defined as 
sampling set. 

Due to the previous arguments, the following Lemma has been inferred [ReqSO]. 

Lemma 2.2.1 If the nonuniform sample locations {t*,} satisfy the Nyquist rate on the 
average, they uniquely represent a band-limited signal if the sample locations are not 
the zero crossings of a hand-limited signal of the same bandwidth. 

The following corollary can be inferred from the Lemma. 

Corollary 2.2.1 If the average sampling rate of the set of sampling instants {4} is 
more than the Nyquist rate, then the samples taken at tk ’s uniquely .specify a hand- 
limited signal and {i*.} is a sampling set. 

Proof: The average density of zero crossings (real zeros) of a signal band-limited to 
[-W, W] is less than or at the most equal to the Nyquist rate (2 W), for deterministic 
[Tit39] and random signals [Ric45]. Therefore when a signal band-limited to [-W, W] 
is sampled at a rate more than 2W, then the sampling positions cannot be the zero 
crossings of a signal band-limited to [—IF, IF], Hence the samples, so taken, form a 
unique sampling set. 



2.2 Nonuniform Sampling 


17 


First we discuss the general nonuniform schemes, subsequently the methods of recovery 
of signals from their nonuniform samples are discussed. The time varying system 
interpretation of interpolation is also discussed. Further the problem of spectrum 
estimation from nonuniform samples is also reviewed. 


2.2.2 Nonuniform Sampling Schemes 

2.2.2. 1 Sampling with a Gap in an Otherwise Uniform Distribution: 

In this scheme of nonuniform sampling, a signal g{t), band-limited to [—W, W], is 
sampled uniformly for t < 0 and it is also ensured that a sample falls at t = 0, but 
for t > 0 the first sample is taken at 5 + 5^. The subsequent samples are taken at 
5 -F n > 0 for t > 0. Hence a gap of 6 is introduced for the first sample for t > 0. 

In other words. 


( nT, n < 0 
^ (5 nT, n > 0 


( 2 . 11 ) 


If (5 < T, then the samples {t„} uniquely specify the signal g{t). Under these 

conditions Yen has proved the following theorem [Yen56]. 


Theorem 2.2.1 If g{t), band-limited to [—W, IF] is sampled at tn specified by 2.11, 
then the signal can be reconstructed using the following interpolating formula, 


00 

9it) = H 

n=— 00 


( 2 . 12 ) 
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Figure 2.1: A signal sampled with a gap in an otherwise uniform distribution 


where, 
4’nit) = 


(-l)”r(2iyA + n) 
r(2W^t)r[2iy(A - t)]n! 

(-l)”r(2VFA + n) 
r{2Wt)r{2W{A - t))n\ 


X (n + 2Wt) \ n < 0 
X [n + 2H^((i - t)]"\ n > 0. 


This case has been shown in the Figure 2.1. 


2. 2. 2. 2 Periodic Nonuniform Sampling: 


In this sampling scheme, N nonuniformly spaced points repeat with a period of NT. 
Let the delays of the one particular set of N points be {rt}. Then the sampling instants 
of all the points can be represented by the following general formula. 
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k 

tnk = nNT + Tfc; n 


1,2,3,. ..,iV 'I 
0,±1,±2,±3,... \ 


(2.13) 


Figure 2.2 shows the periodic nonuniform sampling scheme. 

The reconstruction of the signal from the samples can be done by applying the following 
interpolating Equation [Pou77]. 


9{t) 

where, 

1pnk{t) 


oo N 

H YlaM^nkit) 

n=— cx) k=l 

2irW(t - t„t) nil,, sin - r,-)) 


(2.14) 


(2.15) 


2. 2. 2. 3 Jittered Sampling: 

When the samples are placed around the uniform samples (nT), then they are called 
jittered samples. These samples might be clustered either deterministically or ran- 
domly. A typical example is when the samples get jittered due to the uncertainty at 
the receiver end. 

For deterministic jitter Popoulis [Pou66] has proposed a method for reconstructing 
the original signal from the samples. Let g(tn) be the samples of the signal which is 
band- limited to \—W, W], We construct a signal x{t) which has the uniform sample 
values equal to g{tn). In other words, x(t) is a function such that x{nT) = g{tn). 


20 


Nonuniform Sampling: A Review 



Figure 2.2: Periodic nonuniform sampling of a signal 


Let there exist a function 0{t) such that, e{nT) = And let 9{t) be band-limited 
to [-Wi, Wi], such that Wi < -^ then, 

= Y.^nSinc 

Therefore x{i) = g{e{t)) and x{nT) = g{9{nT)) = g{u). Further if x{t) is band- 
limited, then. 

Sine - nj 

Finally if 9{t) is an invertible function then, g{t) = x{9~'^{t)), which leads to, 

^(0 = Yl9{'tn) Sinc(^-^ (2.16) 

If |nr- t„| is small then the assumption that x{t) is band-limited is valid. If g{t) is 
band-limited then, in general, x{t) is not band-limited, and therefore 2.16 is only an 
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approximation. But if x{t) is band-limited, the g{t) cannot be band-limited, hence 2.16 
is an exact representation for this class of nonband-limited signals. 

Clark et al. [JJCL85] have suggested that this method can be used for reconstructing 
a certain class of nonband-limited signals. 


2. 2. 2. 4 Implicit Scimpling: 

In this type of sampling the signal is sampled at instants at which the signal takes 
a predefined value. For instance, may be selected such that g{tn) = 0 or the 
is selected at the crossings of the function g{t) with A cos[2u)tn)- The first implicit 
sampling was considered by Bond and Cahn [BC58]. They considered the case when 
g{t) is a function band-limited to [—W, W\ and represented the function in terms of 
the zero crossings. They extended ‘f to the complex variable ‘z’ and finally obtained 
that. 


SW = S(0) fl (l - f ) . (2-17) 

where /(O) 7^ 0, Zn = Rn < Rn+i and formula 

2.17 it has to be noted that the past and the future zeros have to be known. 

Another problem they have considered is that, in which the zeros in the interval 
[~ i”’ f]’ ^ ~ 2 Tv occur at slightly less than the Nyquist rate and outside the interval 
the zeros occur at the Nyquist rate. Further, let there be number N < WT and there 
be maxima of 2N zeros in [^, ^]. These zeros are denoted by z„ = + zu„, |tn| < 

T/2. Outside this interval these zeros occur at = ± for n = N’-l-l, N+2, ...,. 

Under these conditions Bond and Cahn [BC58] finally represented the function g{t) in 
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terms of g{0) and z^s. The expression for reconstruction is as follows - 


^ sin{27rWt-mr) 

git) - E (-1) ■’ 


n=-N 


where is represented in terms of the 2N zeros inside the interval. 

Hm 2vfe: - n) 


An = ^( 0 ) 


m:^n 


Where m is the index of zeros within the interval [— ?, T 


(2.18) 


(2.19) 


Bar-David[BD74] has considered the problem of representation of signals in terms of 
implicit samples, when the sampling instants are real variables (in contrast to the 
complex variables which are used in the previous case). He considered the case when 
the sampling instants are such that ^(t„) = cos( 27 rtn). The representation of the 
signal from the samples follows from the following theorem. 


Theorem 2.2.2 Let g{t) be a hounded hand-limited function of bandwidth Wq, such 
that, the sampling expansion given by, 


9iz) 




\2Wj 


27rW2 — nn 


( 2 . 20 ) 


converges uniformly, for W > Wq, in any hounded region of z plane. Let C > |p(f)| 
and let 

fi~) = {t : 9 {t) = C cosi2r:Wt)}, n , -2, -1, 0, 1, 2, . . . , . 

Then the following product also converges uniformly though conditionally, in the same 
region. 

On} = b(0) - C] Ji^JJ ^1-^) +c cos(7rlVz). (2.21) 


A sufficient condition for the convergence is that t±jt should indicate the 
the right (left) of the origin. 


zero to 
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2. 2.2.5 Randomised Sampling: 

In this type of sampling, the sampling instants are selected randomly. The sampling 
operation is mathematically deftned as the product between g(t) and u{t). Where u{t) 
is given by, 

OO 

WO = E (2-22) 

CXD 

The sampling instants tk's can be selected in two ways. One possibility is to sample 
tk = tfc-i ■+Tk, k = 0, 1, 2, .. ., where r*. is realisation of the random variable r. This 
type of sampling has been defined as additive random point process and was introduced 
by Sharpiro and Silverman [SS]. 

Another possibility for obtaining random samples is to take 

tk = kT + Tk- 

Bilinskis and Mikelsons [B1M92] have stated that the ratio where a and fx are the 
standard deviation and mean of the probability distribution of the random variable rjt 
respectively, plays a significant role in randomised sampling. This ratio can be varied 
to cover the complete range from deterministic to extremely randomised sampling. 

Next we discuss the spectral analysis of randomly sampled signals. Let the signal to 
be randomly sampled be given by g(t) and let the sampling be done using u{t) given 
by 2.22. Let the estimated spectrum, when the signal is sampled at 2N instants, be, 

G(/) = E 

k=-N 

The sampling instants are selected using the probability distribution function (l>k{t). 
The expected value of the estimated spectrum is given by, 

E|<5(/)| = E r g(t) Mt) dt 

k—Sl-'-" 
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= r g{t) f; ci>,{t)] dt 

k=-N 

If 

limj Mi)] = C, (2.23) 

then 

^ roo 

^[G(/)] = C 

= CG{f). 

Hence we can conclude that the expected value of the estimated spectra of a randomly 
sampled signal, coincides with that of the spectra of the respective original signal, if 
condition 2.23 is satisfied. 

This type of sampling is very promising in cases where there is no apriori information 
of the incoming signal. In such cases, the spectral estimation of an incoming signal 
can be done by sampling at randomly realised sampling instants in a large number of 
scans and the spectra can be estimated. The number of scans have to be increased till 
the estimate of the spectra stabilises. For a thorough study of randomised sampling 
we refer to [BM92]. 


2.2.3 Methods for Reconstructing Signals from Nonuniform 
Samples 

2.2.3. 1 Lagrangian Interpolation: 

An interpolating function, for nonuniform samples, which resembles the Lagrangian 
interpolation has been proposed by [Beu66],[Hig76]. Here the derivation of the inter- 
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polation is presented. 

Let be a basis set in the frequency domain. The basis function in frequency 

domain is complete if any signal band-limited to W can be represented in the frequency 
domain as, 

G(/) = f:c„e^'“‘% 1/1 <1^. (2.24) 

— OO 

The inverse Fourier transform of 2.24 is given by, 

CXD 

g{t) = '£cnSinc{2W{t-t^)), (2.25) 

— OO 

where Cn is the inner product of g{t) with another function t^„(t), which is called 
biorthogonal of Sinc{2W{t — t„)). 

/ OO 

g{t) ipnit) dt, (2.26) 

“OO 

and, 

/ OO r 1 = 77 

In Equation 2.25 the Cn’s are not the samples of the signal at t„’s, except for the case 
when t„ = nT. Equation 2.25 can be written in the sampling representation as 

OO 

9{i) = giQi’nit) (2.27) 

n=: — OO 

This equation can be readily verified as follows - 

Ei^(^^-)P = E I f g{t) Sinc{2W {t - tk)) dtp, and by biorthogonality property 

k k 

= El^fcl^- 

k 

Hence if is complete, then the representation in Equation 2.27 is complete. 

An important problem is to find an explicit expression for ‘ipk{t)- An expression for a 
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general complete set {t„} is not known. But under restrictions, an explicit expression 
can be found. 


For the case when - nT\ < D <j, n = 0, ±1, ±2, . . ., } is a basis for band- 

limited signals in the frequency domain and ipnit) can be shown to be the following 
Lagrangian function, 




m 


ipn{tn) = 1 and ipn{tk) ^0, k^n. where, 


(2.28) 


The condition 



(2.29) 


\tn -nT\ < D < j, n = 0, ±, ±, ... (2.30) 

ensures the convergence of the expression 2.27. If the sampling set {t„} is finite, say 
: 0 < n < N} then the classical Lagrangian interpolation formula is obtained. 
Hence Equation 2.28 can be considered as a generalised version of the Lagrangian 
interpolation. 


If the condition given in inequality 2.30 is not satisfied but the rate of is higher 

than the Nyquist rate on the average and satisfies |t„ — nT\ < L < oo, — f,„j > 

S > 0, m ^ n, the interpolation Equations 2.27 and 2.28 are still valid but the but 
the product in 2.29 does not converge. However it can be shown that the following 
product converges pointwise and uniformly 

I/(t) = e‘“(t - to) n (2-31) 

The omission of a finite number of samples does not alter the situation and the Equation 
2.31 is still valid. 
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2. 2. 3. 2 Interpolation When the Samples of the Signal and the Differentials 
are Given: 


For this case, an interpolation formula, using the Lagrangian formula, has been derived 
by Rawn[Raw89]. The following theorem states the interpolation formula - 


Theorem 2.2.3 Let g(t) be band-limited to [~W, W], and the samples of g{t) and its 
R-1 derivatives be known at tn- Let be such that — nRT\ < Then 


9{i) = iZ 


9{in) +(i-y) 9\in) + . .. + (^1 - g^ ^(tn) [^n(i)]^ 


where, 



and, 


5* (in) = 


(-l)'=(t„)'= d!^ ( g{t) 


k\ dt>‘ 


e=t„, 0<k<R-l 


Convergence of the series is uniform on (— oo, co). For the case when = nTR, the 
interpolation reduces to uniform derivative sampling interpolation given by Linder and 
Abramson [LA60]. 


2. 2. 3. 3 An Iterative Method of Signal Recovery: 

In this section an iterative method of signal reconstruction from nonuniform samples is 
discussed. This method is proposed by Wiley[Wil78] and uses a theorem by Sandberg. 

Theorem 2.2.4 Let Q be mapping of fC in K, where K is a class of bandlimited square 
integrable signals, such that, for all f,g E K,: 

Re{Qf - Qg, f - g) > hWf - gf 


(2.32) 



28 


Nonuniform Sampling: A Review 


\\PQf - PQgll < hWf - sll, (2-33) 

1 /2 

l^ere (,) denotes the inner product and li/(i)|l = 

and ^2 are positive constants. Then for h E fC the equation h = PQf has a unique 
solution (^PQ)~^h £ K, given by {PQ) ^h = liiUn-yoo/n where, 

fn+l = - PQfn) + fn (2.34) 

K2 

and fo is an arbitrary element of 1C. Furthermore for all hi, h 2 € fC 

\\{PQ)-^hi - iPQ)-^h2\\ < Y^hi - Mil- 


Based on this theorem the sampling method is presented next. Let s(t) be an interval 
average sampling function given by, 

f 1 ni < + < 1 
= } ( 2 ^ ^ - 2 

^ ' 10 otherwise 

Let the non-equally spaced interval average sample sequence of a band-limited square 
integrable function g{t) be 


sm) = T. 




/*tn 1 o' 


dt 


(2.35) 


Let the sequence t„ have the following properties 


iMi - ini > d > 0 


n 

- 2Z 


< 


L 

Ws 


(2.36) 

(2.37) 


Let e < d; in other words, the duration of the sampling pulse is to be less than minimum 
time between the sampling instants. Inequality 2.37 states that the spacing between two 
consecutive samples should be greater than a certain fixed positive quantity. Equation 
2.37 requires that the separation between the sampling instants and the corresponding 
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uniform samples should be less than a fixed value. The sequence is said to have a 
uniform density of 2fs according to a definition by Duffin and Schaffer [DS]. Further 
let P be the band-limiting operator which transforms an arbitrary signal in L^(R) into 
a band-limited signal, in other words, 


P(G(f)) = 


G{f) \fi<B 
0 I/I > B 


In [Wil78] it is shown that P and 5() together satisfy theorem 2.2.4. Therefore the 
iterative scheme used in the theorem can be used to recover the signal from the samples. 
Let f{t) be the original signal and /(tj), i E Z he the nonuniform samples. Let the 
LPF filtered version of the samples be h{t). If /n(t) is the approximation of the 
signal f{t), then 


fn+l = - PQU) + /„. 

K2 

The scheme is shown in the Figure 2.3. In this figure - 


(2.38) 


P - low pass filter, 

S() -sampler, defined in the Equation 2.35, 
fn{t) approximation of the original signal, 

h - the low passed version of the samples. 


2. 2. 3. 4 A Nonlinear Method of Signal Recovery: 

Before discussing the recovery problem, we present the spectral analysis of the nonuni- 
form samples [Mar92]. 


Let g{t) be the original signal and the pulse train, using which it is sampled, is denoted 
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h(t) 



Figure 2.3: The scheme for the iterative method for signal recovery 
by 9 p{t), and let 

9p{t) = (2.39) 

k 

Let gs(t) be the samples of the signal at instants tk, k € Z. Then, 

9s{t) = g{t) gp{t) 

and the theory of generalised function states that, 

5{t-tk) = |i(t)U([a:(t)]), (2.40) 

provided that x(tk) = 0, i(tk) ^ 0 and p(f) has no zeros other than at tk- One possible 
x{t) can be written as, 

xit) = t-kT-0{t), (2.41) 

and 9(t) should satisfy the following condition. 


tk-kT-e{tk) = 0 . 
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Hence 0(tk) = tk — kT is the deviation of the samples from the uniform samples. From 
Equations 2.40 and 2.41 we have, 


-tk) = 11 - e(t ) I 6{f -kT- d{t)) (2.42) 


with the condition that l^(t)| ^ 1. Marvasti and Lee [ML92] have given a sufficient 
condition so that this is valid. Substituting the value of 6{t — tk) in 2.39, we have 


g,{t) = |1 -»(()] E 5(4>(t)-kT) 

k:=—oo 

where d>(t) = t — 6{t). Since ~ periodic with respect to (p{t) with a 

period T, its Fourier series expansion is given by. 


x; sm) - kT) 

— oo 


T 

\^-m 

T 


k 

oo 

1 + 2E cos 

fc=l 


/ 27rkt 

[— 


27rk9{t)\ 

“T—J 


It can be inferred from the above equation that gp{t) has a DC component of plus 
a phase modulated signal, the phase modulation index given by Substituting for 
Qpit), gs{t) is given by, 


9s{t) = git) 


\i-m 


1 + 2 ^ cos 

k=l 


' 2Tr kt 2'Kk(f>it)' 


If it is assumed that the bandwidth of d{t) is less than the modulation falls in the 
category of narrow band phase modulation. And the phase modulated part has a band- 
width of approximately twice the bandwidth of ^(t), which is less than Therefore 
low pass filtering ^p(t) yields 


g,(t) =(!#) 

for 1> 9. If the bandwidth of 9it) is taken to be Wg, and if ^ — Wg — W > W + Wg, 
there is no overlap between the narrow band PM signal and Gif) * (— |:). Thus low 
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reconstruction of 
g(t) 


g(t) 

P 


Figure 2.4: The scheme for the nonlinear method of signal recovery 


pass filtering the nonuniform samples gs{t) gives 

m = «(‘)(^-^) (2,43) 

Therefor, the original signal can be recovered by dividing g^lt) by gp{t). 

The recovery algorithm from the samples is shown in the Figure 2.4. The original 
samples are low pass filtered and g^it) is obtained. The samples are also used to 
obtain gp{t), the pulse train, by thresholding and finding the mod value (magnitude). 
Then low pass filtering gp{t), gp{t) is found. Subsequently dividing gs{t) by gp{t) the 
reconstruction of g{t) is obtained. 


2. 2. 3. 5 Interpolation Using Generalised Sampling Theorem: 

Before presenting the technique of interpolation, we discuss the Generalised sampling 
theorem [Kra59]. 
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Theorem 2.2.5 Generalised Sampling Theorem: Let x{t) be representable in the fol- 
lowing form 

x{t) = j }C{s, t)g{s) ds, (2-44) 

where, g{s), K{s,t) € Let there exist {t„}, such that, )C{s,tn) forms a Complete 

Orthonormal set on L^{I). Then the signal x(t) is representable as 


x{t) 

where, 

Sn{t,tn) 


= lim 

N -¥00 


x{tn)Snit) 

\n\<N 


fjK{x,t)K,{x,tn) dx 
fj \K{x,tn)\^ dx 


(2.45) 


(2.46) 


Proof: Since K{s,tn) is a completely orthonormal set, therefore, 


where. 


9{s) = YlcnK.{s,tn) 

— OO 

fjg{s)K.{x,tn) dx 


(2.47) 


Cn{t) = 


fj\]C{x,K)f dx 
X(tn) 


fj \K{x,tn)\^ dx 

Multiplying Equation 2.47 on both sides by fC{s, t) and integrating with respect to s 


leads to, 

oo 

x{t) = x(t„)5„(t,t„) (2.48) 

n=: — cx> 

If the set {tn} is available, then, x{t) can be reconstructed using the Equation 2.48. 


Example- Bessel’s Interpolation- In this case K.{s,t) = sJm{st), where Jm are Bessel 
band-limited functions, band-limited to I=[0,W]. The interpolation function is given 


by 


x{t) 




Jmjt) 

{tn t)Jm^i{tfi) 


The proof can be found in [Mar92]. 


(2.49) 
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2.2.3.6 Stability in Nonuniform Sampling: 

In this discussion, the definition of stability and the condition for stable sampling ex- 
pansion are reviewed- A few examples of stable sampling expansion are also presented. 

A given class of signals {git)} is said to possess a stable sampling expansion if there 
exists an admissible class of sampling sequences of real numbers t„,n € /, where I is 
an index set of integers fixed for each admissible class, such that the class of sequences 
of sample values t„, n € J determines the class of signals in some sense (for example, 
a certain error norm tending to zero). 


Definition 2.2.1 A sampling expansion is called stable if small corruptions in the 
amplitudes of the sample values leads to small changes in the reconstructed signal using 
the sample set [Lan67]. 


Yao and Thomas [YT67] have defined the concept of stability with reference to band- 
limited signals only. Let git) be the signal under investigation. Let the uncorrupted 
sequence of samples be giU) and the noise function be fit) which is band-limited 
to [-B, B]. Since the class of functions is a linear class, the corrupted sequence of 
samples is given by giQ + fitn),n G /. And the corresponding corrupted function is 
igit) + fit)) which is band-limited to [-B, B]. 

Ne.xt the condition for stable sampling expansion is presented. The class of functions 
band-limited to [-S, B] is said to possess a stable sampling expansion with respect 
to a class of sampling sequences n € I, if there exists a positive finite absolute 
constant C (C is independent of gft) and t„, n 6 I), such that, the condition 

rig^dt < ci:is(t„)i^ 


(2.50) 



2.2 Nonuniform Sampling 


35 


is valid for each sampling sequence and for each band-limited signal g{t). The definition 
is apparently motivated by the fact that if the condition in Equation 2.50 is satisfied 
and additionally if the norm of the corrupting sequence given by Z)nl/(^n)P is 
bounded, then the mean square reconstruction error is also bounded. This can be 
shown as follows - 


mean square error = 

r \g{t)- (git) +fm^dt 

J ~CX) 

(2.51) 

= 

r \m\^ dt 

*/~oo 

(2.52) 

< 

c 

n 

(2.53) 

< 

CS, if x:i/(t„)p<<^<oo. 

n 

(2.54) 


Before closing this subsection two examples of stable sampling expansion are presented. 

Example-1 The class of signals band-limited to [-1/2, 1/2] possess a sampling expansion 
given by 

oo 

— oo 

with respect to each sampling sequence t„ from the class 

— n] < d < 1/4, n E I = {0, ±1, ±2, ....} (2.55) 

In this expansion ipn(t) is given by 

. . G{t) 

where, 

G(t) = (t-to)n(l-l/tn)(l-i/i-n). 

n=l 

This is a stable sampling expansion. 
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1 jv tn r-i + — i - possess a sampling 

Example-2 The class otfunctions band-limited to 1 , + 2,<2 iJ 

expansion given by 

ffii) ~ 

— CX5 

with respect to each sampling sequence t„ from the class 

lf„ - nj < L < °° 

oo > \tn-U > 0, n^m 

Each composing function is given by 


" (t - tn)G'(tnj 


where G(t} is given by, 


G(t) = Ae°^(t - to) n 

n=— oo,n^0 


t/ tn 


or 


G(t) = Be“((- to) 11(1 

n=l 

with 

a = - + l/t-n) and b = 0 

n= 

This is also a stable sampling expansion. Further details can be found in Yao and 
Thomas[YT67]. 


2.2.4 Nonuniform Sampling of Time-Limited Signals 

In the previous subsection we have considered the nonuniform sampling of signals on 
R. Here we will be discussing the nonuniform sampling of time-limited signals. In most 
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practical situations nonuniform sampling occurs as an undesirable effect and there is 
no choice but to deal with nonuniform data. A few examples are as follows [Mar92]. 

1) For applications in seismology and oceanography, when data is measured in a moving 
vehicle, then due to fluctuations in speed, random or uniform samples with jitter are 
inevitable. 

2) Data tracked in digital flight control. 

3) Data read from and recorded on a tape or disc with speed fluctuations. 

4) Data loss due channel erasures and additive noise. 

However, we review cases, wherein, nonuniform sampling has been deliberately intro- 
duced. 

The basic problem that occurs in applying nonuniform sampling is as follows. Let g{t) 
be a signal sampled in the interval I, at the points U, i = 0, ..., A — 1. If g{t) is the 
reconstruction of the signal using a given interpolation procedure, then it is required 
to find the optimal U, i = 0, ..., N — 1, such that the error between g{t) and g{t) is 
minimised. This statement can be stated mathematically in the following way - 

£opt = min ||p(t) -^(t)|P 

(to, = {(to, : hit) - = ^opt] (2.56) 

For example, this problem can be attempted with spline interpolation; in this case 
the error has to be minimised with respect to the knot locations. Attempts to solve 
the optimisation problem have been done [BdT88], [MGCH88]. Similarly, Shahein and 
Abbas [SA94] have attempted to compress ECG signals using cubic spline interpolation 
by placing the knots at nonuniform interv’-als. In spite of these attempts, how the local 
variations affect the sample locations has remained vague. 

In this thesis, two aspects of the same problem have been formulated and algorithms 


fa solving the problems have been presented. In Chapter 4 of this thests t^he op t.ma 

,^pHngproblemisattempteaandana,orithntispresented.Forso^^^^^^^ 

the time-scale localisation properties of the wavelet transform are utrhsed. P^^ 

5 the sample number distribution problem has been solved, leadmg to a mu rr ^ 
smnpling strategy for time-limited signals. The problem considered is to d.str.bute 
.. ImL Of samples in m partitions of the inter^ I sna - - - -- 

error between the original signal and the reconstructed s.gnal IS mimm. ^ ■ 

of the partitions the samples are placed uniformly. Certain constraints on the type o 
the interpolation used are also placed. Finally an algorithm for multirate samp mg .s 
presented. For solving the problem the notion of scale-limitedness with reference to 
wavelet transforms is used. The notion of scal^limitedness will be mtroduced m tre 


Chapter 3. 
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Signal Variation Characterisation 
Using Wavelet Transforms 


In this chapter, a new signal variation measure, called scale-limitedness, is introduced 
with reference to wavelet transforms. A signal is called scale-limited if its wavelet 
transform is zero for all values of the scale below a certain value and for all shifts. 
The practical considerations due to which this concept has emerged have also been 
discussed. It has been shown through simulations, that signals with smaller scale- 
limits, have faster variation. 

Scale-limitedness is similar to band-limitedness, but has some additional properties 
which makes it very useful. As an extension 5o-practical scale-limitedness has been 
defined. Finally, a few properties of scale-limited signals have been established. It is 
shown that all band-limited signals are scale-limited with respect to a class of wavelet 
families. Further, the existence of time-limited signals which axe also scale-limited is 
established. Moreover, it is proved that, the larger the value of the scale-limit, the 



Ota.acterisat.onjafag^;^:S!^^ 


i, • 1 The class M" is defined and it is shown that the Lagrangian 

rClon flZoints is Really scal.lin.ited with cespect to a wavcM fanniy 
whose mother wavelet is in M” space. 

,■ *■ of the concept of scal.limitedness is also presented. The problem 

An app ica ion limited signals is introduced and an algorithm is 

of sampling rate estimation of time-hmited sign 

U A fnr thp samDline: rate estimation. Initially, the signc 
nrp^pnted which can be used for the sampling idtc 

Which the sampling rate has to be estimated, is sampled at “ " ^ 
depending upon the regnired error performance and the scale-limit of signal, 

..PP««arv number of samples are retained. 


3.1 Introduction 


The technique of applying transforms on sign^s, and studying them in both the original 
and in the transformed domains is well established in the area of signal processing, n 
conventional signal processing, Fourier transforms have been widely used. In recent 

years, however, the application of other transforms has increased. This is mainly due 

, .... Kir Pnnripr traiisfomis. 




liRflt.ion 


There are many applications in the field of engineering, wherein. inipor,,ant informa- 
tion is associated with the transients of the signal. In these cases it is often desirahlo 
to process these transients separately. These applications include: detection of d.arac- 
teristic points, edge detection, segmentation of images, etc. Consequently a need arose 
to develop transforms, which can characterise signals in time as well as in transform 
domains simultaneously. This was one of the reasons for studying wavelet transforms. 
There are certain other transforms which can be used for time-frequency analysis, for 



3.1 Introduction 


41 


example; short time Fourier transform and Wigner-Ville distribution [Coh89]. But 
flexibility in the choice of the kernel of the transform and existence of complete or- 
thonormal bases for discrete wavelet transforms, are some of the reasons, due to which 
the use of wavelet transforms is increasing. 

In wavelet transforms, the domain of the transformed signal is two dimensional; one 
dimension is shift and the other is called scale. The concept of scale is analogous to 
that of frequency in Fourier analysis. The class of band-limited signals consists of those 
signals whose Fourier transform vanishes outside an interval of finite length measure. 
The importance of scale parameter in the context of signal and image processing has 
already been emphasised [SS93], [SS94]. Bandlimitedness in Fourier transforms, has 
played a significant role in signal processing and system design. Consequently, for 
wavelet transform, it is logical to define the notion of Scale-limitedness and investigate 
its properties. 

R. A. Gopinath et. al. [ea94], have defined essential Scale-limitedness for discrete 
wavelet transforms and also shown that band-limited signals are essentially Scale- 
limited. In this chapter, scale-limitedness is defined on the same lines as those of 
band-limitedness. When the magnitude of the scale value is closer to zero, the wavelet 
is sharper, so, the smallest scale value present in the signal plays the role of repre- 
senting the fastest varying component; which is done by high frequencies in Fourier 
transforms. As the scale value is increased, the scaled version of the wavelet becomes 
slow varying. Moreover, at higher scales the amplitude of the term keeps 

reducing. Consequently, the wavelet transform tends to zero at higher scales. 

From the discussion it can be inferred that, for wavelet transforms, the higher limit of 
the scale parameter is, in general, infinity. Therefore, when specifying the scale-limits, 
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only the lower limit is stated, the higher limit is understood to be infinitv. So the 
concept of scale-limit proceeds on the same lines as band-limitedness, but the higher 
limit for scale-limit being infinity, is not stated. For practical applications, <5o-practicaI 
scale-limitedness is defined, which reduces to essential scale-limitedness in the case of 
discrete wavelet transforms. 


3.1.1 Wavelet Transforms 

Definitions 

Here we briefly review important definitions related to wavelet transforms, for details 
refer to [Dau92]. A function 6 is called a wavelet if it satisfies the following 
condition, 

c* = /i/r' < oo, (3.1) 

where, 

/ OO 

dt. 

■OO 

If ^(/) is continuous, then the condition 3.1 is satisfied only when ^/(O) = 0 or 

J dt = 0. Using a doubly indexed family of wavelets i.s generated by 
dilating and translating, 

r‘(i) = , 

where a, 6 e i?, a # 0. We use positive as well as negative a at this point, however, 
in all subsequent places the wavelet transform and its inverse is computed for positive 
a. The normalisation factor is chosen such that = j|0||. 
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The wavelet transform of g{t) € L^{R) with respect to the family is given by 

Wg^^{a,b) = { ), ( 3 . 2 ) 

= J g{t) 

We assume that ||^1| = 1, so that \Wg^^{a,b)\ < ||^(t)||, this follows from Cauchy- 
Schwarz inequality. 

A function g{t) can be recovered from its wavelet transform via the resolution of the 
following identity: 

m = ! J, r-\t), ( 3 . 4 ) 

•J d^A. J bQ.B (X 

where Wg^^{a,h) 0, <2 e A C (0, 00 ], b E B C R. The energy of the signal g{t) is 

given by, 

r mfdt = (3.5) 

J —00 J ol^A Jb^B a 

3.1.2 Practical Implementation of Wavelet Transforms: The 
Discrete Wavelet Transform 

In Fourier transforms, the kernel of the transform is the function e-'"', in the case of 
wavelet transform the kernel is not unique. Any function which has finite energy and 
satisfies the admissibility condition (Equation 3.1) can be used as a wavelet. Obtaining 
such functions is a difficult task, but Mallat [Mal89] and Meyer[Mey91] have solved the 
problem partially by introducing the concept of Multiresolution analysis. 

In Multiresolution analysis, the scale and the shift parameters are discretised and the 
wavelet transform is found only at discrete values. Typically, the scale parameter can 
be discretised to dyadic values, so that a = 2-', j E Z, b — k2^, j, k E Z. 
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Tisme Wavelet ■Ransforms 


Here only a brief outline of the concept is provided, 
in [Dau92]. In Multiresolution analysis, a sequence 
denoted by Vj, j € Z is constructed, such that. 


a detailed discussion can be found 
of successive approximation spaces 


P 1 


... c Vi c Vo c v_i c V2 ... 


p 2 

= l\R) 

P 3 

rijezV,- = {0}- 

There is an additional constraint that, for 5 € L (i?), 


P 4 

g €Vj 5 ( 2 ^) ^ ^0 


P 5 

p e Vo ^ gi-- k) ^ V k e Z. 

This implies that all spaces should be scaled versions of 1/.. To characterise the space 
Vo, an orthonormal basis is required for it. In Multiresolution analysis, this Inusis is of 

the following kind, 

<j){t — /c), k ^ Z. 


So that. 
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P 6 


< (f>{t - k), (j){t - j) >- 5jk. 


The basis of the space Vj is denoted by {(l>j^k '■ k e Z} and is given by, 

<t>j,k = 2-^/^ 4>{2-H-k) (3.6) 

Since, Vq C Vli, 0o,o should be representable in terms of (f)-i,n, n E Z. 

^0,0 = hn 0-1, n 

n 


or, 0(t) = V2Y, K (t>{2t - n) (3.7) 

n 

By shifting t to {t — k), it can shovim that all the basis of Vo are representable in terms 
of the basis of VLi. Incidentally, Equation 3.7 also implies that, 

0i,O ~ ^ ^ hn — l,n 

n 

By shifting t by t — A:, it is straight forward to show that all the bases of Vj are 
representable in terms of bases of Vj_i. Therefore Equation 3.7 also implies that 
Vj C Vy_i. Hence to obtain property P 1, only Equation 3.7 has to be satisfied by the 
basis. 

The basic result in Multiresolution analysis can be stated through the following theo- 
rem. This theorem establishes the existence of a wavelet basis ipj^k, j ^ Z, k E Z for 
L^{R), where 

^j ,^ = 2-^!'^ i){2-H-k) (3.8) 


for a given Multiresolution analysis setting, in which the properties P 1-P 6 are satisfied. 
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1 Vt i ii'{ Iraijyfflrmg 


/• h: 


Theorem 3 . 1.1 If a ladder of si^bspaces {\ ,) ,c ?■ 

Tlpe.tHenV.,ae^Uanassccialedor,,,oao.^^^^^ 

\ ^ ' 
Fy-i = Pi + ■' 

One possmty for the construction of the a-ardcl ..<■ 




c<:2f 


i 3 . 9 i 


( 3 , 10 ) 


The convergence of the series is in L -sense. 

The space spanned by ^j,k is denoted by ii r Hniu . 

Vj-i “ i j 0 J 

For further analysis the notation of approximate and <iei.nl • irmd' r ii-tnalueed, 

< g{t)ihk ^ approximate signal ui tla- 

by A^g. < g{t)A,k >,keZ, is called the detail signal m the j”* -pa. ami is denoted 
by Pjp. 

For the purpose of practical implementation of the algonihm, the ■ aii.ph's of the sipal 
are taken equal to the approximate signal in the space V„ t Pa e this asMimplion is 
made, successive approximate signals in spares V,. \ V < an b< intnai ami also the 

detail signal in the spaces W^,j = 1,2,3,... ran he found This .e -umption is made on 
the following grounds. The scaling function Cii) is a hnv- p,ea fibej 1 h<* approximate 
signal in Vq is given by, 

/ OO 

(j>{t - k)g{t)di 

-OO 

/ OO wi 

G{f)0U)e^y^^Tkdf 

-OO 
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If, G(/) # 0, / e l-B, S] and V'(/) = 1, / € {-B, B], Then, 

J S 

= 9{k) 


Hence the approximate signal for j = 0 is g{k), k £ Z. Next it is shown that the 
approximation can be found if the (j — 1)‘* approximation is known. It is also shown 
that the detail signal can be found if the {j — approximate signal is known. 

From Equation 3.7 it can be shown that, 


— y ^ kfn—2k (^-H) 

m 

therefore, < g(t),(j)j^k > = '^hm- 2 k < git),<J>j-i,m >, (3.12) 

m 

01 , A) g = (3-13) 

m 

Hence the approximate signal at the level can be obtained by convolving the 
approximate signal at {j level by the filter Td and then subsampling by 2. 


Similarly starting from Equation 3.10 with Z„ = (—1)" the following relation 

can be shown, 

~ 'y ^ ^m— 2fc — l.mi (3.14) 

m 

therefore, < git),‘ipj,k > = < g{t),(l)j-i^m>, (3.15) 

m 

ov,D^g> = 'Z'UlTk A]l,g (3.16) 

m 

Hence from the approximate signal at the {j — 1)‘^ level the detail signal at the can 
be found. The detail signal, denoted by Djg, is the wavelet transform Wg^^{a,b) for 
a = 2'’, b = k2^. The final algorithm is shown in Figure 3.1. 




In section 3.2, scale-limitedness is defined and its various extensions are given. In sec- 
tion 3.3, the connection between scale-limitedness and the vanishing moment property 
is discussed. The theorems related to scal^limitedness are presented in section 3.4. 
In section 3.5, an algorithm for sampling rate estimation is presented, whidi uses the 
concept of scale-limitedness. Finally the conclusions are presented m section 3.6. 


3.2 Scale-limitedness 

The practical considerations which have led to the emergence of this conci'pt are 
outlined below. The wavelets at low scales have faster variation; this is illustrated 
in the Figure 3.2; where (a) is plotted for a=0.25, 1, 4 respecti\eh, wheie 
7 p{t) = {Trt)-\sin{ 27 rt) - sin( 7 rt)). In wavelet decomposition, low scale wavelets 

capture the relatively fast varying portions of the signal. To elaborate this further, let 
us go into the definition of the wavelet transform. The wavelet transform is an inner 
product between g{t) and (^)' parameter b shifts the wavelet by b 

units; as a result of this, Wg^^{a,b) gives the behaviour of the signal at t = b. 

The admissibility condition ensures that J ip {t) dt = 0, i.e., the mean of the wavelet 
is always zero. If the signal g{t) is constant on a set of finite length measure around 
the point t = b, then there exists a certain oq, such that, Wg^^,{a,b) = 0 for a < oq, 
when compactly supported wavelets are used, however, for the case of noncompactly 
supported wavelets, the wavelet transform will have a relatively small value. In general, 
due to the admissibility condition, the value of the wavelet transform is low in those 
regions, wherein, the signal is relatively slow varying as compared to the wavelet. This 
point is further clarified, when the relation between scale-limitedness and vanishing 
moment property of the wavelet is discussed. Moreover, if g{t) is slow varying for 
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Figure 3.1: Implementation of Multiresolution analysis 


t E D C R, then there exists cq such that, for a < ao and b E D, Wg^^{a,b) will have 
negligible contribution in reconstructing g{t) from Wg^^{a,b), aE R^^b E R. 

In the following a few examples are presented, which illustrate that the wavelet trans- 
form of a signal g{t) will have relatively large value for shift parameter taking values in 
a subset of the real line, if the signal has relatively fast variation for time parameters in 
the same subset. We take 240 samples of the signal, then the multiresolution analysis 
is used to find the wavelet transform of the signal. In all the examples we have taken 
240 samples for computing wavelet transforms. The number of samples taken equal to 
2^ for some positive k. In our case we compute wavelet transform upto scale 16 only, 
which means that at the last level the approximate signal in the decomposition has 15 
samples. This has been done to reduce the required storage space. Decomposition upto 
level scale equal to 16 is sufficient to prove the correctness of the theory. In Figure 3.3, 
a test signal g{t) is plotted, which has fast variation in the interval [100,200]. In Figure 
3.4, taking the signal in Figure 3.1 as g{t), Wg^^(2,b) has been plotted. The wavelet 
transform of the same signal for scales 4, 8, 16 respectively have been plotted in Fig- 
ures 3.5, 3.6, 3.7. This wavelet transform is computed using Daubechies 8'^ compactly 
supported wav^elet [Dau92] and Mallet’s algorithm [Mal89]. The length of the filter hn 
corresponding to this wavelet is 16. It can be obser\'ed that the curve VFj ,^(2,6) has 
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4 6 8 10 12 14 16 

t 


Figure 3.2; foJ’ a=0.25, 1, 4. 



Figure 3.3: The test signal. 
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Figure 3.4: The wavelet transform of the test signal shown in Figure 3.3 for scale value 
equal to 2. 


significant values in the interval [85,185], which is same as [100,200] translated by 15 
time units. This shift has occurred due to the asymmetry of the mother wavelet. From 
this example, it can be inferred that at low scales, the wavelet transform is enhanced 
in a region where the signal variations are fast in time domain. To some extent, this 
feature can be observed in Figure 3.3. However, at higher scales this feature gets less 
prominent. 

A similar behaviour can be observed in the next two examples. In Figure 3.8 the test 
signal shown has significant variations on the sets given by [0, 30] and [130, 180]. The 
wavelet transform of the signal for scales 2, 4, 8, 16 respectively has been plotted in 
Figures 3.9, 3.10, 3.11, 3.12. In this case as well, at scale value equal to 2, the wavelet 
transform has significant values in the sets which are left shifted with respect to [0, 

A L LiB^r 

s. 1. T. . KAM??jri’ ' 

125677 
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Figure 3.5: The wavelet transform of the test signal shown in F’igurc 3.3 for .■^calc value 
equal to 4. 


30] and [130, 180]. However at higher scales, the phenomenon of wavelet transform 
enhancement for scale parameter taking values in sets where the signal is varying fast 
becomes less prominent. This can be observed from the plots in Figures 3.8, 3.9, 3.10. 

In Figure 3.13, the test signal analysed in the third example has been inr.senK'd. this 
signal has many regions of fast variation. In this example as well, at low scales, the 
wavelet transform has significant values in the region which is hTt. shifted from the 
region in which the signal has fast variation. Gradually at higher scales this behaviour 
gets less prominent. The fact, that the wavelet coefficients can be used to find the 
points of time at which significant changes occur, has been observed in (DJ94]. By 
eliminating fast varying components, it is possible to construct signals which are scale- 
limited. For any wavelet 0(t) and a given uo, a class of signals g(t) can be constructed 
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Figure 3.6: The wavelet transform of the test signal shown in the Figure 3.3 for scale 
value equal to 8. 


for which Wg^^{a, b) = 0, for a < oq and all 6. The class of scale-limited signals, scale- 
limited to oo, consists of signals which do not have faster variation than that indicated 

byV’(^). 

3.2.1 Definitions 

Definition 3.2.1 Scale-limitedness: A signal g{t) E L^{R) is said to be scale-limited 
to Oi with respect to a wavelet family if (^)> Q £ R^,h € R, if Wg^^{a,h) = 0, 
for a < ai, ai > 0, V6. 


The class of scale-limited signals for w^hich a E (aj,oo), consists of signals which do 
not have faster components than those indicated by the wavelet V' (^)- 






Figure 3.8; The test signal. 
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Figure 3.9; The wavelet transform of the test signal shown in the Figure 3.8 for scale 
value equal to 2. 


Signal 

Scale-limits 

Dyadic scale-limits 

4(a) 

8.2092 

8 

5(a) 

4.0870 

4 

6(a) 

2.6250 

2 


Table 3.1: Scale-limits and dyadic scale-limits of the signals shown in figures 3.18, 3.20, 
3.22, for 5o = 0.05 






Figure 3.10: The wavelet transform of the test signal shown in the Figure 3.8 for s( ale 
value equal to 4. 


Definition 3.2.2 6o-Practical Scale Limitedness: A signal g{t) e is called 5 q- 
practically scale-limited to ai if 


ai 


sup{a'i : 


/o“' r 


oo dadb 
00 


1 14 ^ 


S.V’ 


(a.6)p 


E 


< <5o}- 


(3.17) 


where, 

E = for P^^definedSo, 0 < 4o < 1. 


Through the notion of (5o-practical scale-limitedness, all those signals are classified, for 
which the fraction of the energy below a scale value is less than a predefined quantity. 

Next, a few examples are presented in which three signals and their scale-limits are 
found. In these examples, the signals and their energy distribution with respect to the 
various scales, has been presented. Here the energ}-^ distribution with respect to various 
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Figure 3.11: The wavelet transform of the test signal shown in the Figure 3.8 for scale 
value equal to 8. 


scales is characterised by S(a'i), which is equal to the energy content in the signal below 
the scale a{. The quantity (5(aJ) is given by the following - 


s(a;) = 


(3.18) 


Since the Multiresolution algorithm is used to find the wavelet transform, the value of 
S(ai) is found only for a'l = 2, 4, 8, 16. The value of 5(aJ) is given by - 


5{a[) = 


E 


a\ = 2\ j = 1, 2, 3, 4. 


The energy of the signal is approximated by - 


(3.19) 


E = 


(3.20) 
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Figure 3.14: The wavelet transform of the test signal shown in the Figure 3.13 for scale 
equal to 2. 


Hence 5(a'i) is given by- 


6ia[) = 


E. \9{tk)? 


CL] 


= 2 \ j = l, 2, 3, 4. (3.21) 


Using the plots of 5(a{) versus a{, the scale-limits of the three signals have been evalu- 
ated. 

Computation of the Scale-limits: Since the available Multiresolution algorithms 
provide the wavelet transform for dyadic sccile values, therefore the intermediate scale- 
limit values are obtained using linear interpolation. For finding the scale-limit for 
So = 0.05, these are the steps: 
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Figure 3.15: The wavelet transform of the test signal shown 


in the Figure ior scale 


value equal to 4. 


• Find j = jo such that; 


5(2^°) < 0.05 < 5(2^'’+^) 


• Then use the interpolation formula for finding the scale-limit: 


ai 


2^0 + 


(2J0+1 _ 2J0) 
(5(2Jo+i) _(5(>)) 


-(0.05 -1^(2'")) 


In Figure 3.18, the signal to be scale analysed is shown; in Figure 3.10 the fraction 
of the energy below a\ is plotted with respect to a\. From the curve, the scale-limit 
of the signal curve shown in Figure 3.18 is 7.8934. Scale-limits of the signals shown 
in Figures 3.18, 3.20 and 3.22 are tabulated in Table 3.1. It can be inferred from 
the examples that signals having faster variation have smaller scale-limits. Therefore, 
scale-limit can be used as a measure of variation of the signals. In the same table 
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Figure 3.16: The wavelet transform of the test signal shown in the Figure 3.13 for scale 
value equal to 8. 

scale-limits are also tabulated for the case, when the permissible values of the scale- 
limit are 2-’, j E Z. These scale-limits are called dyadic scale-limits. It is important 
to note, that if a signal is scale-limited with respect to a wavelet family, then it will be 
scale-limited with respect to another wavelet family if both the families generate the 
same multiresolution analysis. 

In reference [ea94], the scale-limitedness is defined such that the signals have only 
dyadic scale-limits. By allowing scale-limits to have real values it is possible to charac- 
terise variation in a much more effective way. Because an addition of small amount of 
energy at smaller scales may not alter the dyadic scale-limit, however, the (5o-practical 
scale-limit defined here would get changed. 




3.5 



Figure 3.18: The test signal 
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Figure 3.23: S{a'i) vs aj, for the test signal shown in Figure 3.22 


3.3 Higher Order Vanishing Moments and 
Scale- limitedness 


Here it will be shown, that the property, that signals with faster variations have smaller 
scale-limits, is due to higher order vanishing moment property of the wavelets. Essen- 
tially, for faster varying signals to have smaller scale-limits, faster signals should have 
their wavelet transform enhanced at lower scales. This is ensured by the higher order 
vanishing moment property of the wavelets. Before discussing this in further detail, 
two notions, namely - space of M" and effective support are introduced. 


Definition 3.3.1 Space of M^: A function G L^{R) is said to be in M”, if 

f'il’ix)x‘dx = 0,1 = 0, ...,n. 




WecdlM" as the nvanisUng moment space. This in ton. .n.,, in. in c- ,r: .V, 

= 0,0 > 0,i = 0....n. Letusdcfino.he„u.i..nMf,if.->:v, of a 

Jet; this notion is applicable to the class of square mlepr.aiile fumiuou. 

DeSnition 3.3.2 Effective Support: The wavelet vit) .md u. Ur, „ -on 0 / 

R,C Rif, 


R, = 


B 


f},() 


< c 


Let US separately write the equation in the definition as follows. 

ft e RK 

E 


(3.22) 


The existence of such /?* ’s follows from the square integrahility of th»* wavelet. 

Lemma 3.3.1 There exist R^ ’s such that the Equation 3.22 is satisfied for a piecewise 
stjum integrable function ip{t) and for 0 < e < 1. 


PROOF: Let us define a function F^{x), 


F^{x) = 


B 


Since F^(m) is a cumulative energy distribution function, therefore, it is non tiecreasing. 
So for any e < 1, where E is the energj' of the function t/>, it is possihh* t o find 
uncountably many {xi,X 2 ) such that (F^fxf) - F^,{xi)) = t. This (‘.stahlishes the 
existence of jR-’s for every given 0 < e < 1. 


RJean also be constructed as Uj(xij,X 2 j), the disjoint sets xaj) selected such that 
Ej(f(^ 2 j) - F[xij)) = £. For compactly supported wavelets, we take « “ L s® 
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that equal to the support of the wavelet. For non-compactly supported wavelets e 
close but not equal to one. So that, a large fraction of the Wavelet energy falls in the 
effective support. At low scales the effective support of the Wavelet V'(f) reduces. It 
is straight forward to show that if has an effective support of i?i and ■0(^) has 
an effective support of i ?2 and Oi > 02 then L{R 2 ) < L{Ri). At low scales inside 
the e-effective support(e close to 1) if the signal is given a polynomial representation 
then a slow varying signal gets represented by lower order polynomials. Suppose the 
wavelet is in the A/” space, signals represented by polynomials of order less than 
order will have zero wavelet transform, if the wavelet support and the support of the 
signal overlap. In general, slower signals will have low wavelet transform at low scales. 
The wavelet transform of a signal satisfies the following bound - 

|Wp,^(a,6)p < miriiKn [ \g{t) - g{t)\^ dt 

J 0 

Where g{t) is an order Lagrangian approximation of the signal g{t). This can be 
proved by writing, g{t) = g{t) + {g{t) — g{t)), then taking the wavelet transform 
and noting that, the wavelet transform of g(t) is zero because it is a polynomial of 
order less than or equal to n. Then Cauchy-Schwarz inequality can be applied to 
prove the result. Hence, within the support of the wavelet the closer a signal is to any 
polynomial upto order n the smaller will its wavelet transform be. Therefore, slower 
signals (which are approximated with very low error upto order n) will have larger 
(5o-practical scale-limits. 


3.4 Properties of Scale- limitedness 


In the first theorem, it is shown that the class of band-limited signals are scale-limited 
with respect to wavelets which satisfy a certain condition. 




Theorem 3.4.1 4 signal band-limited tc [-B.B] ts satle-UmUed ta i rcepcrt to a 
wavelet family a S ^ R for which i,(f) - 0, |/| < U 


PROOF: The wavelet transform of the signal g(t) with respect to the family is 

given by 

Wg,^{a,b) = {9A‘''\t))i 

= r^df G{f) Wf) by Parseval's theorem. 

J-B 

If, 

G{f) = OJ ^ (-B,+B), 

'ipif) = 0,/ € 

then the smallest value of ‘a’ for which Wg^.^{ci,b) 7^ 0 is a = hence for a < g, 
Wg,4a,b) = 0 . 

Hence proved. 

The next theorem states that there exist time-limited signals which are scale-limited. 
This is fairly straight forward because the wavelets considered are compact, but there 
is no parallel to this result in Fourier transforms. Because there is no time-limited 
signal which is band-limited. 


Theorem 3.4.2 With respect to every compact support wavelet family there exists a 
class of time-limited signals which are scale-limited as well. 
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PROOF: Let be compact on (— Ci,C 2 ), Ci, C 2 > 0. Let us consider the class of 
signals generated by, taking I (a, 6)1 < oo, and, 


Wg^{a,b) = 0,a^[a/, ttu], 

Wg^{a,b) = 0,6^[6/, 6„]. 


The class of signals generated is given by. 


gii) 


c: 


ri‘ 

J ai •J bi 


dadb 

— ^sAa^b) rP 



1 


It is important to note, that, for a ^ [a/, Ou] and 6 ^ [6; b—u] ‘ip (^) = 0, f or t < bi— 
C\ au,t > 6u + Ou C 2 . Hence the class of signals g{t) so generated is time-limited to 
6/ — Cl Cu < t < bu + C 2 - So the class of signals is shift, scale and time-limited. 

Hence proved. 

The next theorem states that the modulus value of the derivative of a scale-limited 
signal is upper bounded by 


Theorem 3.4.3 For the class of n times differentiable scale-limited, time-limited sig- 
nals, the derivative satisfies the following inequality. 


\—g{t)\ < — , 

- ar 


(3.23) 


where, 

C' = _^(C2-|-Ci) |V’"(0Uax Ml 

provided that the wavelet has compact support of (— Ci,C2), Ci, C2 > 0 and its 
differential exists. 
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PROOF: If V'W has a support of (-01,02), Ci, 02 > (* th(ii ' i.a'- a f ujiport of 
(aci,ac2). 



9{t) 

= 

J (X ^ A 

ib € 

dadb 
B of 


y,{a. h) 





j 

^ Ja e A 

f 

dadb 



(F _ 

Then, 


— 

Jb € 

s 

t/f" 


(P 


, r 

r 

dadb , 



1 (C, 

and. 


< 

^ Ja e A 
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or, |^p(()| < 
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where, C' = ;^(o2 + Oi)||p(t)|||V;"(t)|, 
Hence proved. 


Corollary 3.4.1 For the class of differentiable scale- limited, ttme-hnnird signals the 
derivative satisfies the following inequality, 


where, 


\j^ 9 it)\ < - 

at ai 


C = c;'{c, + c,) W'(()U„ llsll, 


(3.24) 
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provided that the wavelet has compact support of (— Ci,C2), Ci, C2 > 0 . If the first 
differential of the wavelet exists. 


The next theorem states that under certain conditions the Lagrangian interpolating 
function is (5o-practicaIly scale-limited on a finite interval. Let g{t),t E [0, yl] be the 
original signal and g{ti), i = l, ..,n be the samples of the signal in the interval [0, A]. 
Let g{t) be the approximation of the signal obtained by using the n samples using 
Lagrangian interpolation. Then, 

9 (f) ~ y^.9(.U)^i, , _ ■ 1 [O) A\, 0 otherwise; (3.25) 

»=i ~ h 

g{t) can always be written in the following form 

g{t) = Oq + ai t + 02 t^ + ... + t G [0, A], 0 otherwise. (3.26) 

Let -ip^t) be a compact wavelet with support [— Wi, W 2 ]- Also let 'i/»(t) be in (n — 1) 
vanishing moment space. Then we have the following theorem- 


Theorem 3.4.4 The time-limited interpolating function g{t) given by 3.26 is 60 -prac- 
tically scale-limited to ai for 


s:uKz\,„. da db 

60 = — g + g . 


(3.27) 


provided that 'd'it) is in M" ^ space and also compact with support [— u>i, W 2 ]. 


PROOF; For a/ to be do-practical scale-limit, Sq should be equal to the fractional energy 
for a € [0, oi] and for all ‘b’. For a G [0, a/] and b ^ [-Oi W 2 , A -f- o/ mi] the wavelet 
transform is zero, because there is no overlap between g{t) and xp (^)- The wavelet 
transform is given by, 
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Figure 3.24: j(() and for b=n, »>., -'I - ur "<■ 

Refer to figure 3.24. since s(t) ia gi™ >>y Equation 3.26 and v(( j ia in H vanishing 
moment space, W,, *(o, V) = 0, for a S [0, o,l and 6 e Ic u,, .4 - o: nw). Therefore for 

aelO, ml, the region ofV in which W,,e/0. is 1-0, U'„ a, u.,lu|.4-«, n'r. .4+«,»,|. 

The fractional energy for this region rs given by Equation ,3,27. Hence ,f is .selected 
equal to the value given by 3.27, then j(() "'iU bo do-Ptartically scale-linuted to a. 

Hence proved. 


Theorem 3.4.5 j4ny function g{i) € Vj is scale-lirmted to V . 


Proof; Since g{t) € Vj, therefore g{t) e Therefore gft i hii.s t 

representation. 


git) = H II idit), 

k-j-l n=~oo 



(t-n2^\ 1 

I, 2*: \ 2‘ ) 


hf following 
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Let us compute the wavelet transform of the function g{t) with respect to the wavelets 
given by, for Z € Z and m = 0, 1, j - 1, j. 

For I e Z and m= 0, 1, j — 1, j, 

1 — 


OO OO 


t-n2'=\, , 1 , ft-n2^\ 1 


_ J ’TP 


Ip 


't - Z2" 


Since the Multiresolution analysis forms an orthonormal wavelet family, 




't-n2'‘\ 1 


2 '= 




xP 


't - 12^ 


) — ^Ti,l ^k,m- 


Therefore, for / € -S’ and m = 0, 1, ..., j — 1, j, 


Wg,^{2^,l2^) = 0 . 

Any function in Vj is scale-limited to 2L 
Hence proved. 


This result follows from the definition of Vj, however the obvious result has been proved 
in an elegant way. 


3.5 Sampling Rate Estimation using the Concept 
of Scale-limitedness 

In this section, an algorithm for estimating the required sampling rate for a signal, given 
the required error performance, is proposed. An expansion in terms of the samples is 
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also presented. The concept of scale-limitedness with reference to wavelet transforms, 
which has already been introduced, is used as the measure of variation. Tlu* proposed 
algorithm proceeds by sampling the signal initially at a high rate, then recursively 
subsampling depending upon the required error performance. 

In conventional signal processing, the Shannon sampling theorem is applied and signals 
are sampled uniformly. The sampling rate is taken to be 2B, if the bandwidth of the 
signal is B. A detailed account of Shannon’s theorem and its various extensions can 
be found in [Jer77], [Mar93]. In practice, this presents two problems due to the time 
limited nature of practical signals. 

• An apriori estimate of the bandwidth must be known. 

• Only a finite number of samples are available; therefore the n'sulting ajtproxima- 
tion of the signal in terms of the samples is subject to truncation error [Beu76]. 

In the absence of any information of the bandwidth of a signal, it becomes very difficult 
to estimate the sampling rate required. Here an attempt is made to solve the problem 
using wavelet transforms. The problem attempted here is as follows- Given any finite 
duration signal, whose samples are available at arbitrary high rate, what is the sampling 
rate required for representing the initial set of samples with a specified error bound c. 

The problem of representing a discrete signal in terms of samples of the wavelet trans- 
form domain is extensively studied. The wavelet transform of a signal is the inner 
product between the signal and shifted, scaled versions of a function called the mother 
wavelet. In practice, only the samples of the signal to be analysed are known. The 
approximation of the signal can be found by passing the sequence through a bank 
of filters[Mal89]. Algorithms based on this concept provide a method of represent- 
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ing a discrete sequence in terms of the wavelet transform values at scales 2^ and the 
corresponding shifts 2^ k. Using the approximation sequence at any stage and the 
transforms (detail signals) at the previous stages, the original sample sequence can be 
reconstructed. All this has been discussed in detail in the earlier sections. 

In [Mal91],[MZ92], [MH92] the original seimple sequence is represented in terms of the 
maxima of the wavelet transform at scales 2^ for a range of consecutive integers j 
and the final low pass approximation. This algorithm is based on Mallat’s conjecture 
that the wavelet transform maxima and the final low pass version are sufficient for 
complete representation of the signal. Meyer [Mey91] has given counter examples to 
show that this conjecture is not correct, but practically it leads to a sufficiently accurate 
representation of the original sample sequence. 

In [Ber92] the completeness problem of a non-uniform sampling of wavelet transform of 
a periodic signal discrete time signal is studied. In this case the sampling was done at 
the extrema of the transform. In [AHT95] the completeness of an arbitrary sampling 
of a discrete time wavelet transform of a periodic signal is dealt with. 

Instead of representing a signal in terms of the samples of the wavelet transform and 
approximate signal, here the wavelet transform decomposition is used to estimate the 
sampling rate required in the time domain. The motive behind developing a sampling 
rate estimator is that, it is much more useful to store samples of a signal rather than 
samples of any transformed version. 

The strategy evolved here is to initially sample the given signal at a very high rate, then 
subsample by a fraction of 2, repeating the process till the reconstruction error remains 
within the permissible limit. Simulation results for speech and simulated signals are 
presented. Here it is shown that for a given number of samples the error bound is 
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inversely proportional to the scale limit. 

3.5.1 Theory behind the Sampling and Rcconsl ruction Algo- 
rithm 


The sampling problem attempted here, is posed as a problem of iriinniiiF.Tfion of the 
fractional mean square reconstruction error between tin’ oripiiial sipnal aiul the recon- 
structed signal using the samples. The problem attempted here is a.', follows - Gurn a 
signal g{t),t G [0,yl], where A is a positive fimte number, what is the nwnmum sam- 
pling rate required such that the fractional mean square reefwstfuetnm error remams 
bounded by a predefined quantity e. 

Next we present a theorem which gives a bound on the fracti«nial mean srpiatc' recon- 
struction error in terms of the samples used for reconstruction. Although the theorem 
developed here is for continuous signals, the algorithm is adapted for the case when 
initially the samples are available at an arbitrary rate and the rec|uired number of 
samples have to be picked out of the inijyal set, such that the fractional mean square 
reconstruction error between the initial sample set and the reconstrurted sample set is 
minimised. 

Before stating the algorithm, the main result is presented. Let //{f), t G (d, .4] be the 

original signal and it is sampled at N points, t,-,? = 0,1 N - 1, where f, € (0, .4]. 

Let the energy of the signal be E. The main result is as follows- 


Theorem 3.5.1 The fractional mean square reconstruction error satisfies the following 
inequality, 
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Or, 

So < < ^ + '5o 

Hence proved. 

Let us denote the fractional mean square error in the transformed domain by Err (a, n), 
in general ‘b’ takes values on B{a) therefore, 

Err{a,n) = [ \Wg^^{aoh)-W^,^,{a,b)f db. 

JbeB{a) 


The basis of the assumption 3.29 is that as the number of samples incremsr.s, the original 
and the reconstructed signals come close, which in turn implies that the transformed 
signals of the original and the reconstructed signals come close. Therefore, any mono- 
tonically decreasing function can be used to bound the error, the specific form given 
in inequality 3.29 is assumed because it is computationally easy to deal with. 

The strategy of sampling adopted is, that initially the signal is sampled at an arbitrary 
high rate, then, the required number of samples are retained such that the fractional 
mean square reconstruction remains less than the required value. Let the initial number 
Df samples be No and number of samples finally retained be N. Before discussing the 
application of theorem 3.5.1, the following simplifications are made: 

1) Only dyadic scale-limits are considered, so a, = 2^’ j > 0. Therefore in place of 
^ 0 ) are substituted in the inequality, where 5 d^ 2 j is the fraction of energy below 
V.. 

;2) k>0. 

3) Given any n, the reconstruction is done according to the following equation: 
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Y' gOm 2*) —7= — d) 


m=l 


2 ^ 


The condition (2) ensures that the rate of sampling obtained is a 2“'=th multiple of 
the initial rate of sampling, where k is an integer. The reason for taking such rates is 
that it is easy to combine signals sampled at such rate for transmission as well as for 
storage purposes. 


The condition (3) ensures that g{t) is scale-limited to 2*. For applying the inequality, 
for ai = 2^ the reconstructed signal g{t) should be scale- limited to 2K For n = ^ this 
is ensured by taking 2^' > 2^ or n < ^. 


Under these simplifications, the final form of theorem 3.5.1 is. 


^d,2i ^ 






n°ai 


n < 


2^ 


r) 


(3.30) 


For any specified e, the strategy adopted for sampling is as follows: First the values of 
are found, upto the j value, such that, < e- Let jo be the largest integer of j 
such that < e. Next the value of reconstruction error is calculated forn = if 
it is less than e, then values of j higher than jo are tested till the error becomes larger 
than e. This provides us with the lowest sampling rate possible for a specified error e. 
If the reconstruction error is more than e for n = 2^, then lower values of j are tried 
till the lowest possible sampling rate is obtained. 


Before discussing the algorithm, a few practical considerations are discussed. Theoret- 
ically the fractional mean square error is given by the following integral - 


fractional mean square error 


V - m? it 

/o-’ |S(()P dt ' 
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however, we make the following approximation. 








( 3 . 31 ) 


Any other method of area calculation can be used. 


Secondly to quantify the reduction in the sampling rate a performance measure, de- 
noted by r(e), is defined. 

_ Minimum number of samples for a reconstruction error /ess them t 

Initial number of samples 


3.5.2 Algorithm for Sampling Rate Estimation 

The problem that has been attempted here is to obtain the sampling rate of a tinie- 
bmited signal such that the fractional mean square reconstruction error remains bounded 
by €. Practically, the problem is, given Nq samples of a signal it is required to find the 
smallest number N, such that, the fractional mean square reconstruction error between 
the original sample set and the reconstructed sample set using N samples is less than 


The algorithm presented here utilises the theorem presented in the previous .section. 

In developing the algorithm we utilise the result that the fractional mean square error 

when the signal is reconstructed using f where No is number of samples in the initial 
set, is lower bounded by 

First the values of for; = i, 2 , 3. 4 are found. Then the largest value ofi is 
found such that 3^,, < fractional 

mean square error for A' = M *re A', are the initial number of samples. 
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If this fractional mean square error is less than e, then the optimum number of samples 
are either N or less than N. Next we find the fractional mean square error for the 
number of samples equal to ^ for k > jo, until k = j^t is found such that the fractional 
mean square error for is greater than e, but the fractional mean square error for 

samples is less than e. If the fractional mean square error for j = jo is greater than 
e, then the fractional mean square error for successively lower values of j is computed. 
And this process is stopped when j — j^pt is found, such that the fractional mean 
square error when the reconstruction is done using is less than e. 

^opt 

If there exists no j such that the fractional mean square error using ^ samples is less 
than or equal to e, then all the samples have to be retained and using the algorithm 
no compression is possible. 

For a given performance specification that the error should not exceed e, the possible 
reduction in the sampling rate can be found using the following algorithm. 

BEGIN 

Step 3.1 Sample the given signal at the highest possible rate and store in g[i], i=0, 
No-l. 

Step 3.2 Fiiid Jot all j > I and 

Step 3.3 If no exists such that j > 1 and Then all the samples have 

to be kept and the algorithm be stopped. Because under this condition this algorithm 
will not give any sampling rate reduction. 


Step 3.4 If there exists jo ^ F such that, 6^ 23 — ^ for j < jo, then find the fractional 

llg(h-g(0lP 


mean square error, given by ^ error is less 
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than e, then check the fractional mean square error mthn=^ for successively higher 
values of} starting from jo + 1. And select the minimum expected sampling rate. 

Step 3.5 In step 4, if the reconstruction error is greater than e, then check the re- 
construction error for successively lower values of j and stop the iteration when the 
minimum possible sampling rate is obtained. 


END 

In step 4 the largest is selected so that the search for the optimum sampling 
rate starts from theoretically minimum possible value. It is important to note, that 
in practice the g{t) may not be strictly scale - limited to 2^’ since at the edges the 
functions 4>{t) get windowed. 


3.5.3 Simulation Results 

In the simulation results that are presented in this section, two sets of signals are taken 
and using the algorithm, the sampling rate reduction is found. Further, the values the 
values of the C and a parameters for the respective sets are found using the the first 
three signals of each set and these parameters are used to predict the fractional mean 
square error for the fourth signal of each set. The sets of signals used for two examples 
are presented in the Table-3.2. 

Two classes of signals have been analysed using the proposed algorithm. First the set of 
simulated signals are analysed and the possible reduction in the sampling rate is found 
for a predefined value of e. The second class considered is of vowel sounds sampled at 
lOksamples/sec. In both the cases, three signals are used to find the parameters C 
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Example 1 

Example 2 

1 

sin{exp{—0.2t)t) 

utterance ooo 

2 

cos{0.lt) sin{exp{—Q.2t)t) 

utterance uuu 

3 

sin{sin{exp{—0.2t)t)0.1t) 

utterance eee 

4 

exp{—Q.0h t) 

utterance aww 


Table 3.2: The sets of signals used for sampling rate estimation 

and a. These values are used to predict the error for a test signal. Even in the absence 
of any error specification, the bounds are useful to get a rough estimate of the error. 

For both the cases the value of € is taken to 0.2. The tables have been given after the 
figures, wherein the actual values of errors are presented. 


3. 5. 3.1 Case 1: Simulated Signals 

For a class of simulated signals, the value of r(e) for e = 0.2 is tabulated in Table 3.2. In 
the same table the fractional error is also presented. The original and the reconstructed 
signals are shown in Figures 3.25, 3.26, 3.27, 3.28. The simulated signals have been 
used to find C and ct; these values have been used to predict the error bound of the 
signal g,{t). For finding C and o, the value of norm calculated 

with respect to 6), which is denoted by ErrCotn.), has been plotted with respect to n, 
with varying values of a, in Figures 3.29, 3.30, 3.31. In Figure 3.32 the values of all 
the Err(a,n) are plotted. By fixing the value of a equal to 2 and varying the value of 
C, the value of C such that the curve ^ closely upper bounds the curves Err{.a, n) is 
given by 2000. For these values of C and a, the predicted error bound for n = 60, for 
p 4 (t) is given by 0.286997, whereas the actual error from Table-3.3 is 0.176366. 
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3.5.3. 2 Case 2: Speech Signals 

In the case of speech signals the algorithm is tested on the vowel utteiances and 
the values of r(e) are presented in Table 3. The signals are sampled at a rate of 
10k samples /second. The original and the reconstructed signals are shown in the Fig- 
ures 3.33, 3.34, 3.35, 3.36. The utterances ooo, uuu, eee are used to find the values of 
C and a. For finding C and a, the value of Err{a,n) has been plotted with respect to 
n, with varying values of a, in Figures 3.37 , 3.38, 3.39, 3.40. Using the same i)roredure 
in the case of simulated signals, for a = 2 the value of C has been found to he 10500. 
For these values of C and a the predicted error bound for n = 120 for < = 0.2 i.s given 
by 0.451500, whereas the actual error from Table-3.4 is 0.173133. 
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Figure 3.25: The simulated signal g{t) = gi(t) = sin{exp{— 0.2t)t) and the 
structed signal using the proposed scale-limited reconstruction algorithm. 



recon- 


Figure 3.26; The simulated signal g{t) = g 2 {t) = cos{0.1t) sin{exp{— 0.2t)t) and the 
reconstructed signal using the proposed scale-limited reconstruction algorithm. 








Figure 3.29. yg ^ fQj- signal gi{t), where, Erria^n) is the error between 

the original an(;;j reconstructed signal and n is the number of samples used for signal 
reconstruction. 


2.5 


1.5 

Err{0.,ri) 

1 

0.5 

0 

Figure 3.30: yg „ for the signal g 2 {t), where, Err{a,n) is the error between 

the original and reconstructed signal and n is the number of samples used for signal 
reconstruction. 






50 100 „ ISO 21)0 


Figure 3.31: Err{(i,n) vs n for the signal gsit), where, Errln.?;! the error hetweeii 
the original and the reconstructed signal and n is the number of samples used for signal 

reconstruction. 



n 


Figure 3 . 32 ; Err{o-,n) vs n for the signals 5'i(f), g 2 {t), gi(t) and where, ErrU^^^) 
is the error between the original and the reconstructed signal and n is t he iiuinber of 
samples used for signal reconstruction. 
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0 50 100 150 200 

t 

Figure 3.33: The speech utterance ‘ooo’ and the reconstructed signal using the proposed 
scale-limited reconstruction algorithm. 



Figure 3.34: The speech utterance ‘uuu’ and the reconstructed signal using the pro- 
posed scale-limited reconstruction algorithm. 
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Figure 3.35: The speech utterance ‘eee’ and the reconstructed signal using the proposed 
scale-limited reconstruction algorithm. 



Figure 3.36: The speech utterance ‘aww’ and the reconstructed signal using the pro- 
posed scale-limited reconstruction algorithm. 
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Err{a,n) 4k- 



Figure 3.37; £'rr(a, n for the utterance ‘ooo’, where, £'rr(a, n) is the error between 
the original and the reconstructed signal and n is the number of samples used for signal 


reconstruction. 


E„{a,n) 



Figure 3.38: Errici, n) vs n for the utterance ‘uuu’ , where, Err {cl. n) is the error between 
the original and the reconstructed signal and n is the number of samples used for signal 


reconstruction. 
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8 


6 
5 

Err{a,n) 4 
3 
2 
1 
0 

Figure 3.39: Err{a,n) vs n for the utterance ‘eee’, where, Err{a, n) is the error between 
the original and the reconstructed signal and n is the number of samples used for signal 
reconstruction. 



50 100 150 200 

n 



Figure 3.40: Err{o-,n) vs n for the utterances ‘ooo’, ‘uuu’, ‘eee’, and the function , 
where, Erria, n) is the error between the original and the reconstructed signal and n is 
the number of samples used for signal reconstruction. 





3 5 Sampling Rate Estimation using the Concept of Scale-limitedness 


93 


signal 

r(e), 6=0.2 

Actual error 

5(2) 

5(4) 

5(8) 

5(16) 

9\if) 

0.25 



0.112611 

0.369805 

0.941584 

52 (^) 

0.25 

0.075113 

0.027899 

0.099544 

0.325605 

0.915409 

53 (^) 

0.25 

0.010434 

0.001740 

0.137147 

0.343022 

0.950383 

54 W 

0.25 

0.176366 

0.109399 

0.148108 

0.414172 

0.989439 


Table 3.3: The value of compression (r(e )) for the signals gi{t), gz{t), gi{t), for 

e =0.2. 


signal 

r(6), 6 =0.2 

Actual error 

5(2) 

5(4) 



OOO 

0.25 

0.057822 

0.019652 

0.105810 

0.606019 

0.971977 

uuu 

0.25 



0.155246 

0.388315 

0.963102 








aww 

0.5 



0.225765 




Table 3.4: The value of compression(r(e )) for the signals ‘ooo’, ‘uuu’, ‘eee’, ‘aww’, for 
£ = 0 . 2 . 
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3.6 Conclusions 


The purpose of this chapter is to introduce a new concept, which can be used to 
characterise variations in signals. This concept is proposed with reference to wavelet 
transforms and is termed as scale-limitedness. A few examples are given, in which, 
the signals and their computed scale-limits are presented. The relation between higher 
order vanishing moment property and scale- limitedness is also analysed. Further, a 
few theorems related to scale-limitedness are also presented. Finally, a sampling strat- 
egy is proposed which gives the minimum possible sampling rate for a given error 
performance. 

The chapter starts with the review of wavelet transforms and first the definition of 
continuous w’-avelet transform is presented. Next, the practical implementation of the 
wavelet transform using the concept of multiresolution analysis is discussed. In mul- 
tiresolution analysis, the scale and the shift parameters are discretised and the wavelet 
transform is only found on a discrete set. 

The significance of scale and shift parameters, which are associated wdth wavelet trans- 
forms, is discussed next. It has been illustrated using an example that at lower scales 
the wavelet becomes sharper. This property has an important role in the definition of 
the proposed signal variation measure. 

The wavelet transform of a signal g{t), denoted by Wg^^{a, b), is the inner product 
between the signal and the function -^4’ {^)- The shift parameter, denoted by ‘b’, 
shifts the wavelet to t = 6 and therefore, the wavelet transform gives the behaviour 
of the signal at t = 6. At lower scales the wavelet transform gives the fast varying 
component present in the signal. Therefore, the wavelet transform is enhanced at 
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lower scales, in regions, wherein, the signal is varying fast. This has been illustrated 
by plotting the wavelet transforms of signals shown in Figures 3.3, 3.8, 3.11. 

By eliminating fast \^arying components, it is possible to construct signals which are 
scale-limited. Further, signals which do not have components faster than those indi- 
cated by a wavelet at a given scale, are scale-limited. 

A signal is called scale-limited, if its wavelet transform is zero for all scales below a 
certain scale value and for all shifts. Another definition, termed as do-practical scale- 
limitedness is also introduced. A signal is called 5o-practically scale-limited to ai, if a/ 
is the largest scale value below which the fraction of the energy, for all shifts, is less 
than (5o. Next three examples are presented, in which the signals are plotted and their 
scale-limits are computed. It can be inferred from these examples that, the signals 
which axe faster varying have smaller scale-limits. 

To compute scale-limits, the fraction of the energy, for scales less than 2, 4, 8 and 16 
are plotted with respect to the scale value. Next, for the fixed 5o, which is 0.05 in our 
examples, the largest value of scale is found be which the fraction of the energy is less 
than (5o. This gives the (5o-practical scale-limit of the signal. 

Next the relation between the higher order vanishing moment property and scale- 
limitedness is discussed. It can be inferred that, signals w'hich are faster varying have 
smaller scale-limits because of the vanishing moment property of the wavelet. 

A few theorems have been stated and proved next. It has been shown that, a signal 
which is band-limited is also scale-limited. Moreover, it has been proved that there 
exist time-limited signals w'hich are scale-limited. Further it is shown that, signals 
which have smaller scale-limits have their differentials more loosely bounded. Next 
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it is shown that the Lagrangian interpolating function is (5o“Pi'2'Ctically scale-limited. 
Finally it is shown that, signals which are in Vj are scale-limited with a scale-limit of 

As an application of scale-limitedness, a sampling rate estimation method for signals 
is proposed. For estimating the sampling rate, a theorem is proved, which states that 
signals with smaller scale-limits should be sampled at a relatively faster rate for the 
same error bound. This method proceeds by first over sampling the signal, then finding 
the scale-limit using the multiresolution analysis. And finally, given a bound on the 
error, reduction in the number of samples is found such that the error remains less than 
the bound. The method gives a sampling rate reduction of a multiple of 2^ , where ‘j’ 
is an integer greater than zero. 

Finally, these are the conclusions of this chapter- 

• Signals which are faster varying, have a relatively smaller scale-limits. 

• Scale-limited signals satisfy the following properties- 

- Signals which are band-limited are also scale-limited. 

- There exist time-limited signals which are scale-limited as well. 

- Signals having smaller scale-limits have looser bounds on their differentials. 

- The Lagrangian interpolating function is (Jo-practically scale-limited. 

- Signals which are in Vj have a scale-limit of 2K 

• It has been shown that, for the same error performance, the signals with smaller 
scale-limits should be sampled at a higher rate. 



Chapter 4 


Optimal Sample Placement Using 
Wavelet Transforms 


In this chapter, the problem of sample placement is introduced and an algorithm for 
nonuniform sampling is presented. The sample placement problem deals with the 
optimal placement of the samples in the interval of the signal so that the fractional 
mean square error between the original signal and the reconstructed signal is minimised. 
The interpolation is done using functions which are local, in other words they have most 
of their energj’' concentrated in a small region. For calculating the error between the 
original and the reconstructed signals, the fractional mean square error is used. The 
fractional mean square error is the ratio of the mean square error and the energy of 
the original signal. Simulation results have been presented, in which, the original and 
the reconstructed signals have been plotted. The mean square error verses the number 
of samples has also been tabulated. 
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4.1 Problem Statement 


The problem formulated in this chapter is referred as sample placement problem. 


Given g{t), t € [0, j 4], what is the N tuple (to, ti, •••, tv-Oopt such that i o . ~ 
is minimised, where g(t) is the reconstruction of g{t) using the samples p(t,), U G [0, A], 
Vt and Eg is the energ}' of the signal. In other words, the optimisation problem can be 
written as. 


min 

to, 


Jo^|g(0 - 

E, 


(4.1) 


where. Eg = |^(t)p dt. 


Certain conditions on the type of interpolation to be used, are also assumed, which are 
given below. 


(a) g{t) = g{tk) hk {t-tk,tk-i,tk+i). (4.2) 

k 

(<>) 9(tk) = s(tk)- (4.3) 

(4.4) 

This condition is achieved by setting, 


hk{0j.k-iJk+i) = 1, hk{tj - tk,tk-utk+i) = 0, for j k. (4.5) 

The condition (a) gives a representation of the interpolated signal in terms of the sam- 
ples and certain functions which are window functions. Here, those functions which 
decay down in time are called window functions. Mathematically stated, these func- 
tions tend to zero as |f| — >• oo. The condition (b) on the interpolation ensures that, at 
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the sampling instant, the value of the interpolated signal is same as the value of the of 
the original signal. 


For the purpose of simulation the following form of hk{t,tk-i,tk+i) is assumed, 


hk{t 




tk < t 
t < tk 


(4.6) 


The parameter a* is such that = e. 

The parameter Pk is such that \hk{tk-i — = e. 

Here e is arbitraryly small. In our simulations, the value of e is taken to be 0.1. For 
the form of hk{t) given in 4.6, the condition given in (b) gets satisfied, with a negligible 
error. The problem formulated can be solved by exhaustive search, but then the search 
space of each of the variable is [0, A]. However, we introduce a novel, algorithm which 
reduces the computational complexity of the problem and at the same time gives a 
suboptimal solution. 


4.2 A Suboptimal Solution 

In the practical implementation, the signal is sampled at an arbitrary high rate and 
a large number of samples are obtained. Let the number of samples be Nq. Then 
the problem of N sample placement reduces to picking N samples out of No samples 
such that the error between the reconstructed samples at the initial Nq points and the 
actual function values at those points is minimised. Here an algorithm is provided to 
pick these N number of points. The optimal sample placement for varying values of 
N are found and the original and the reconstructed signals are plotted; the fractional 
mean square reconstruction error is also computed. 
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4.2.1 Strategy Adapted 

For solving the problem, specific properties of wavelet transform description of the 
signal are utilised. These properties are developed as theorems. The basic concept 
utilised in developing the algorithm is to sample the signal initially at those points in 
the time domain at which the wavelet transform has maxima. The subsequent samples 
are picked at the neighbourhood of these sampling instants. After presenting the 
theorems, the reason and the conceptual basis for adapting this strategy is discussed. 

Next we develop certain theorems relating to the mean square error between the original 
signal and the reconstructed signal using N number of samples. 

Let the wavelet transform of hk{t,tk-i,tk+i) be denoted by Wgj,^{a,b). 

Lemma 4.2.1 If the wavelet transform of hk{t,tk-i,tk+i) is denoted by Wf^i^^^{a,b) 
then the wavelet transform of hk{t — tk, tk-i,tk+i) is given by, b — tk). 

Proof: The wavelet transform of hk{t - tk,tk-i,tk+i) is given by 

rOO / f — l)\ 

= j hk{t-tk,tk-utk+i) dt 

Let t — tk = z, then the wavelet transform becomes, 

= J hk{z,tk-i,tk+i) dz 

— b tk)- 

Hence proved. 

It can be inferred from the Lemma that a shift in time domain leads to the same 
amount of shift in the wavelet transformed domain. Using the Lemma we prove the 
following theorem. 
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Theorem 4.2.1 If 


ff(^) = Ylgitk) hkit-tk,tk-i,tk+i) (4.7) 

k 

Then, 


'y y 9i^k)^^hi..ili(0'i b tk) (^-S) 

k 

for all a E S C R, b E L C R. where S and L are the domains of ‘a’ and ‘b’ 
respectively. 


Proof: Taking the wavelet transform of both sides of the Equation 4.7, we obtain the 
following, 


LHS 

RHS 


Hence proved. 


Wg^.,p{a,b) 

Y. (9{tk) hkit - tk, tjt+i)) ^ 

y di^k^ hk(t tk,tk—l,tk+l')lp ^ ^ ^ dt 
Y 9 {ik)Wk,^^i,{a, b-tk), using Lemma 4.1 


This proof is valid for a € 5 C i?, b E L C R. The significance of this result is 
that if any signal has a representation of the kind given in 4.7, then at each scale, the 
wavelet transform also has a representation which in terms of shifted versions of certain 
functions. For developing the final algorithm the inequality versions of the theorems 
are put to use. 


Theorem 4.2.2 If 


^Vg,i,{a,b) = YsiikWk^^A^^b-ik) 


(4.9) 
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For some a E S C R, b £ L C R, then 

dij') ~ ^ ikt ^k—1: tk+l) ^ ( 4 - 10 ) 

k 

provided the following two conditions are satisfied, viz, 

(a) The bandwidth of the wavelet ‘tp{t) is greater than or equal to that of the signal g{t), 

(b) Within the bandwidth, the Fourier transform ofip{t) is zero only on a set of measure 
zero. 


Proof: Let jPf[.] denote the Fourier transform operator, given by, 

roo 

= / 9ii) exp{-j2TT f t) dt 

Joo 

Let ^(/) = Fi[?/'(t)], our strategy is to take the Fourier transform of both sides of the 
Equation 4.9 and equate, this leads us to the 4.10. Let 4.9 is true for some a = a* eS. 


Similarly, 

{-a-f)Hkif,U-i,tk+i), 
wheTe,Hk{f,tk-i,tk+i) = 4-1, tjt+i)] 

Therefore taking the Fourier transform of the LHS and RHS of Equation 4.9 and 
cancellation of the term ipf(—a*f) leads to, 

gilk) hk{f,tk-i,tk+i), ( 4 . 11 ) 

k 

provided that the bandwidth of the signal lift) is greater than or equal to that of g{t)- 
Secondly, within the bandwidth of the xjj (t), the magnitude of ip(f) is zero only on a 
set of measure zero. 


4.2 A Suboptimal Solution 


1 


Hence proved. 

Corollary 4.2.1 If 

Wg,^{a,b) = J29ih)Wh,,^(a,b-tk) 

k 

For all a E S C b E L C R, then 

9{i) = Y.9iik) hk{t-tk,tk-i,tk+i). 

it 

If the following two conditions are satisfied, 

(a) The bandwidth of the wavelet ip{t) is greater than or equal to that of the signal g{t). 

(b) Within the bandwidth, the Fourier transform of'ip{t) is zero only on a set of measure 
zero. 

The proof of this is contained in the proof of the theorem presented above. In fact the 
only difference between the theorem and the corollary is that the corollary considers 
the equality in 4.9 to be valid for all ‘a’ values , whereas in case of the theorem this 
equality is taken only for some ‘a’. 

Next we present the inequality versions of the same theorems. 

Theorem 4.2.3 If, 

[ \9it) - Y.9{'tk)hk{t - tk,tk~l,tk+l)f dt < Crr 

hg Jo Y 

Then, 

f I iW,Aa-,b) - ■£s(tk)Wi,,,.,(a-,b-t,)fdb<M^e.r 

for all a* E S, b E. L{a). Also the following condition is assumed- f)\ < 

M, '^a* E S. 
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Proof: Using Parseval’s theorem- 



Yl9{tk)W,,,4a\b-U)\'^db 

k 


= ^ r IW) - df 

tg J-OO f. 

Assuming that- 


|\/^^(a7)| < M, Va G 5. 


(4.12) 


= — / \G{f) -J29{tk)hk{f,tk-utk+i) \y/la*)xp{a*f)\'^ df 

rjg J-OO ^ 

Eg Jo Y 

.\P 

< — - trr, Again by Parseval’s theorem. 

Eg 

Hence Proved. 

For the type of interpolation given in 4.2, this theorem proves that, if the error in 
the transform domain is bounded at all scales with the additional condition that 4.12 
is satisfied then the mean square error in the time domain has a bound which is 
proportional to the bound on the error in the wavelet transform domain. 

Finally we state the following theorem. 


Theorem 4.2.4 If, 



b - tk) P db < e(a) 

k 


(4.13) 
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for all a £ S, b E L{a). Then, 

f bW - Yl9{tk)hk{t-tk,tk-i,tk+i)\'^ dt < f ^ da (4.14) 

Jtl/g *'0 Joq Cl^ 

Proof: 

■tg Jo ^ 

Prfi’ 

Hfg Jao Cl Jb£L{a) ^ 

Using the inequality 4.13, we obtain, 

-^ / \git) -'^9{tk)hk{t-tk,tk-i,tk+i) dt < [ 

juSp Jo J azzaQ Cl 

Hence proved. 

This result leads to the an algorithm for sample placement. All the theorems indicate 
that if the error becomes small in the time domain then the error in the transform 
domain at all scales also becomes small and vice versa. The final theorem provides us 
with an algorithm for sample placement. 

The algorithm for sampling has to be developed on the basic objective that, the sam- 
ples should be placed in such a fashion that the mean square reconstruction error is 
minimised. From the Equation 4.14, it can be inferred that the strategy of sample 
placement should be such that the mean square error in the transform domain should 
be made small at the different scales, in order to keep the error bound on the recon- 
struction error be small. Further, at lower scales the error in the transform domain 
should be relativeh'’ lower. The reason is that in the error bound in the Equation 4.14 
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is integral of a term which is inversely proportional to c . At lover scales the argu- 
ment of the integral blows up therefore the error e(a) at lower scales should be made 
smaller to make the overall error small. Further, the functions (a, 6) functions 
are local, the reason for this is as follows. If the support of ip is [— Si, $3] and 
since the support of hk{t — tk, tfc-i, h+i) is [ik-i^ the support of 

is [tfc_i - S2, tk+i + si]. Therefore, in order to make the mean square error in the 
transform small at any particular a the t^’s should be selected in regions wherein the 
6)1 is significant. 

The problem of sampling that we have formulated requires the placement of fixed 
number of samples in the domain of the signal. Due to the considerations discussed 
above, we adopt the following strategy of sampling. The initial samples are placed 
at the points in time at which the wavelet transform has maximum at the different 
scales in the ‘6’ domain. In other words, the initial samples are taken at f = fit’s if 
|lFp^(ai,6)| has maxima for 6 = tk for each of the Cj. Moreover', more samples are 
taken using the information at lower scales. Further, if all the maxima are exhausted 
and still same more samples can be taken then they are taken at the neighbourhood 
of the maxima. The strategy adopted for placing the samples around the maxima is 
as follows. First the samples are placed closest to the left of the maxima, subsequently 
the samples are placed to the right of the maxima, ensuring that no two samples are 
repeated. The steps described are repeated until all the samples are exhausted. The 
detailed algorithm is discussed in a subsequent section. 
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4.2.2 Practical Considerations 

Here we discuss the practical implementation of the concept developed in the previous 
subsection. The basic concept proposed is to sample the signal at those instants in the 
time domain at which the wavelet transform has significant values in the transformed 
domain. 

Let us consider the problem of placing N samples at t = 4, k = 0, ..., N — 1. if the 
wavelet transform \Wg^^{a, 6)| has maxima at all scales at 6 = U, i=0, ...N. As already 
discussed in the chapter 3, using Multiresolution algorithm a signal can be decomposed 
into Wg^^(a, b), for a = 2^ and b = k 2^, where j = 1, 2, 3, 4, .... Here we decompose 
only upto j = 4. 

For applying the Multiresolution algorithm, the samples of the initial signal are re- 
quired, therefore the signal is sampled an arbitrary high rate. Next the wavelet trans- 
form is computed by passing the sampled signal through the bank of filters described 
in the Chapter 3. The wavelet with respect to which the wavelet transform is com- 
puted is Once the wavelet transform is computed, the peaks of the wavelet trans- 
form are picked. If for 0 < k2^ < A, \Wg^^{2^ ,k2^)\ > \Wg^^{2^,{k — 1)2^)| and 
\Wg^^,{2\ ^2-’)| > \Wg^^{2\ {k + 1)2-^)|, then k2^ is a maximum at scale 2-’’, therefore we 
sample at t = k2^. If all the maxima are exhausted and some more samples have to be 
placed then they are placed at the neighbourhood of t = b', if the meiximum at some 
scale had occurred at some b = b'. The algorithm is presented in the next subsection. 
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4.2.3 Algorithm 


Before presenting the algorithm we discuss certain practical issues. If N is the number 
of samples to be distributed in the domain of the signal, then it is required to decide, 
how many samples have to be placed using the information of the different scales. Im- 
tially, our policy is to place a maximum of ^ samples using the transform information 
at scale equal to 16, similarly f , f , f are the number of samples distributed using 
the transform information at scales 8, 4, 2, respectively. The reason for making this 
choice is that, the error bound in the inequality 4.14, is inversely proportional to a', 
therefore error at smaller scales in the transformed domain blows the error bound in 
the time domain. Hence to keep the error bound small, t,he appropriate choice for 
sample distribution is to place relatively more samples using infomiation at smaller 
scales. Further, we place the sample at a certain value in time domain if the wavelet 
transform has a maximum, at some scale, at the same value in b-domain. 

If the number of samples allocated to any scale is more than the number of peaks in the 
\Wg^,{a, 6)1 then, there is a surplus of samples. The strateg}^ for placing these samples 
also has to be decided. Our policy is to allocate the surplus samples of all scales to 
lowest possible scale, then if there is a surplus left then these samples are allocated 
to successively higher scales. Finally if the maxima of the 6)| at all scales are 

exhausted and still some more samples of the signal can be taken then these samples 
are placed in the neighbourhood of 6-values at which the maxima have occurred. These 
samples are placed in successive scans. In the first scan the samples are placed in the 
left of the peaks, in the second scan the samples are to the right of the peaks in the 
modulus of the wavelet transform. This sequence of the scans is repeated until all 
the samples are taken, taking into care that the samples are not repeated. The final 



4.2 A Suboptimal Solution 


109 


algorithm is as follows- 
Set A = 0. 

Step 1: Read the input signal g{n] and compute the wavelet transform Wg^^{2^ 
for j=l, 2, 3, 4. 

Step 2 ; Find the local maxima in \Wg^^{2^ , k2^)\ ^t each scale. Note down the 6-co- 
ordinates at which the maxima occur. 

Step 3: Find the number of samples allocated to each scale. If N is the number of 
samples that have to be placed, then, 

Number of samples allocated to scale 16 = 

Number of samples allocated to scale 8 = y. 

Number of samples allocated to scale 4 = 

Number of samples allocated to scale 2 = ^. 

N is chosen to be a multiple of 16. 

Step 4; Calculate the surplus at all scales. This surplus is denoted by Sq. 

So = 

^os(^omber of samples allocated to Scale 2 Number of local maxima in (2.2k)|) 

-I- Pos(Number of samples allocated to Scale 4 — Number of local maxima in lWg,/,(4, 4k)|) 

-f Pos(Number of samples allocated to Scale 8 — Number of local maxima in |Wg,^;.(8, 8k)|) 

-f Pos(Number of samples allocated to Scale 16 — Number of local maxima in |Wg,,/,(16, 16k) |), 

where, 

P (x) I ^ a: > 0 
^ \ 0, Otherwise 
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Step 5: If (So = 0) then goto Step 15, else Number of samples allocated to scale 2 = 
Number of sainpl6s allocated to scale 2 + ^o- 

Surplusi = Number of samples allocated to scale 2 - Number of local max- 
ima in \Wg^^{2,2k)\ 

51 = Pos{Surplusi) 

if {Surplusi) > 0 then 

(Number of samples allocated to scale 2 = Number of local maxima in |Vl'(j,^(2,21c)|) 
If Si = 0 then goto Step 15. 

Number of samples allocated to scale 4 =Number of samples allocated to scale 4 ■+• Si. 
Surplus2 = Number of samples allocated to scale 4 - Number of local max- 
ima in \WgM4k)\ 

5 2 = Pos{Surplus2) 

if {Surplus 2 ) > 0 then ( Number of samples allocated to scale 4 = Number of lo- 
cal maxima in |M^5,,/,(4, 4/i:)|) 

If S2 = 0 then goto Step 15. 

Number of samples allocated to scale 8 = Number of samples allocated to scale 8 -t- 
S2. 

Surplus^ = Number of samples allocated to scale 8 - Number of local max- 
ima in |M'^g,^|,(8,8/c)| 

53 = PosiSurpluSi) 

if {Surplusz) > 0 then ( Number of samples allocated to scale 16 = Num- 
ber of local maxima in |H'"p_^(16, 16/:)|), else goto Step 15. 

Step 6: If [Surplus^] > 0 then Surplus = S3. 
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Step 7: A = A + 1 

Step 8: i = 1, Let N' be the number of samples picked upto this step. 

Step 9: Let the points at which the samples, previously allocated, be picked at bi. 
Check if 6i — A is same as any of the picked samples, if not, then, pick a sample at 
bi — A. Surplus = Surplus — 1. The overall surplus of samples is denoted by 
Surplus. If Surplus = 0 goto Step 15. 

Step 10: i = i + 1, i < N' goto 9 

Step 11: i=l. Let N" be the number of samples picked upto this step. And let bi be 
the location of these samples. 

Step 12: Check if + A is same as any of the picked samples, if not, then, pick a 
sample at bi + A. Surplus = Surplus — 1. If Surplus = 0 goto Step 15. 

Step 13: z = i + 1, if e < N' goto 12 

Step 14: If Surplus > 0 then goto Step 7. 

Step 15: Pick the samples at the alloted number of points at each scale at the maxima 
of |l'P 5 ,^(a, 6)1 and in the neighbourhood of these samples (if the algorithm passes 
through 7-15). Print all the picked samples in a file. 

Step 16: These samples are used to reconstruct the original set of samples, these set 
of samples is denoted by ^[n]. 

Step 17: Find the mean square error which is approximated by step wise approxima- 
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tion. Error = 

SteplS: Stop. 

This algorithm is appUed for Nq = 240, and various values of N. The values of JV 
used are N = 160 , 176 , 192 , 208 , 224, 240. The simulation results are discussed in 
detail in the next section. 


4.3 Simulation Results 

The purpose of this section is to demonstrate the use of the presented algorithm for 
sampling a signal and for its reconstruction. Here we will discuss the sampling and 
reconstruction of four different signals. The number of samples considered for each of 
the signals are 160, 176, 192, 208, 224, 240. In each of the examples first we present 
the table of the reconstruction error, then the plots of the original signal and the 
reconstructed signal for various number of samples are presented and discussed. 

Example 4.1 The signal sampled in this example has been shown in Figure 4.1. In 
Table 4.1, the fractional mean square error for various numbers of samples is presented. 
The various numbers of samples for which the fractional errors have been tabulated are 
160, 176, 192, 208, 224, 240. For each of the numbers the reconstructed signal and the 
fractional mean square error are obtained. To find the mean square error, the signal is 
reconstructed at the initial set of samples. Then, using the original sample set and the 
reconstructed set the fractional mean square error is found. It can be observed from 
the table, that, the fractional mean square error reduces as the number of samples 


increases. 
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Figure label 

Number of samples 

fractional mean square error 

Figure 5.2 

160 

0.245425 

Figure 5.3 

176 

0.226022 

Figure 5.4 

192 

0.144026 

Figure 5.5 

208 

0.127318 

Figure 5.6 

224 

0.006546 


240 

0.000000 


Table 4.1: Error-N for the original shown in Figure 4.1. 


In Figure 4.2, the original signal and the reconstructed signal are plotted for the case 
when the signal, shown in Figure 4.1, is reconstructed using 160 samples. In Figure 
4.3, the original signal and the reconstructed signal are plotted for the case when 
the signal, shown in Figure 4.1 is reconstructed using 176 samples. In Figure 4.4, the 
original signal and the reconstructed signal are plotted for the case when the signal, 
shown in Figure 4.1, is reconstructed using 192 samples. In Figure 4.5, the original 
signal and the reconstructed signal are plotted for the case when the signal, shown 
in Figure 4.1, is reconstructed using 208 samples. In Figure 4.6, the original signal 
and the reconstructed signal are plotted for the case when the signal. Figure 4.1, is 
reconstructed using 224 samples. As the number of samples used for reconstruction 
increase, the original and the reconstructed signals come closer. The fractional mean 
square error verses the number of samples is plotted in Figure 4.7. 

Example 4.2 The signal analysed in this example has been shown in Figure 4.8. In 
Table 4.2, the fractional mean square error for various numbers of samples is presented. 
The various numbers of samples for which the fractional errors have been tabulated are 
160, 176, 192, 208, 224, 240. For each of the numbers the reconstructed signal and the 
fractional mean square error are obtained. To find the mean square error, the signal is 
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Figure 4.2: The original and the reconstructed signal for compression ratio equal to 
0.6667. The original signal was sampled at 240 points, further only 160 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.3; The original and the reconstructed signal for compression ratio equal to 
0.7333. The original signal was sampled at 240 points, further only 176 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 



4.3 Simulation Results 


117 
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Figure 4.4: The original and the reconstructed signal for compression ratio equal to 
0.8000. The original signal was sampled at 240 points, further only 192 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.5: The original and the reconstructed signal for compression ratio equal to 
0.8667. The original signal was sampled at 240 points, further, 208 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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0 50 100 150 200 


Figure 4.6: The original and the reconstructed signal for compression ratio equal to 
0.9333. The original signal was sampled at 240 points, further, 224 points are retained 
at nonuniform sampling instants and the signal reconstructed at the initial 240 instants 
using the equation for reconstruction suggested in the section 4.1. 
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Figure label 

Number of samples 

Fractional mean squeire error 

Figure 5.9 

160 

0.034605 

Figure 5.10 

176 

0.025324 

Figure 5.11 

192 

0.016170 

Figure 5.12 

208 

0.016159 

Figure 5.13 

224 

0.000065 


240 

0.0 


Table 4.2: Error-iV for the original signal shown in Figure 4.8. 


reconstructed at the initial set of samples. Then, using the origincil sample set and the 
reconstructed set the fractional mean square error is found. It can be observed from 
the table, that, the fractional mean square error reduces as the number of samples 
increases. 

In Figure 4.9, the original signal and the reconstructed signal are plotted for the case 
when the signal, shown in Figure 4.8, is reconstructed using 160 samples. In Figure 
4.10, the original signad and the reconstructed signal are plotted for the caise when 
the signal,shown in Figure 4.8 is reconstructed using 176 samples. In Figure 4.11, the 
original signal and the reconstructed signal are plotted for the case when the signal, 
shown in Figure 4.8, is reconstructed using 192 samples. In Figure 4.12, the original 
signal and the reconstructed signal are plotted for the case when the signal, shown 
in Figure 4.8, is reconstructed using 208 samples. In Figure 4.13, the original signal 
and the reconstructed signal are plotted for the case when the signal. Figure 4.8, is 
reconstructed using 224 samples. As the number of samples used for reconstruction 
increase, the original and the reconstructed signals come closer. The fractional mean 
square error verses the number of samples used for signal reconstruction is plotted in 
Figure 4.14. 
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Figure 4.8: The signal analysed in Example 4.2. 
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0 50 100 150 200 

Figure 4.9: The original and the reconstructed signal for compression ratio equal to 
0.6667. The original signal was sampled at 240 points, further only 160 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.10: The original and the reconstructed signal for compression ratio equal to 
0.7333. The original signal was sampled at 240 points, further only 176 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.11: The original and the reconstructed signal for compression ratio equal to 
0.8000. The original signal was sampled at 240 points, further only 192 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.12: The original and the reconstructed signal for compression ratio equal to 
0.8667. The original signal was sampled at 240 points, further, 208 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.13: The original and the reconstructed signal for compression ratio equal to 
0.9333. The original signal was sampled at 240 points, further, 224 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.14: Error verses n for the signal shown in Figure 4.8. 
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Example 4.3 The signal analysed in this example is an ECG signal sampled at a 
rate of 200 samples per second and the 240 samples of this signal are shown in Figure 
4.15. In Table 4.3, the fractional mean square error for various number of samples is 
presented. The various numbers of samples for which the fractional errors have been 
tabulated are 160, 176, 192, 208, 224, 240. For each of the numbers the reconstructed 
signal and the fractional mean square error are obtained. To find the mean square 
error, the signal is reconstructed at the initial set of samples. Then, using the original 
sample set and the reconstructed set the fractional mean square error is found. It 
can be observed from the table, that, the fractional mean square error reduces as the 
number of samples increases. 

In Figure 4.16, the original signal and the reconstructed signal are plotted for the case 
when the signal, shown in Figure 4.15, is reconstructed using 160 samples. In Figure 
4.17, the original signal and the reconstructed signal are plotted for the case when the 
signal, shown in Figure 4.15 is reconstructed using 176 samples. In Figure 4.18, the 
original signal and the reconstructed signal are plotted for the case when the signal, 
shown in Figure 4.15, is reconstructed using 192 samples. In Figure 4.19, the original 
signal and the reconstructed signal are plotted for the case when the signal, shown 
in Figure 4.15, is reconstructed using 208 samples. In Figure 4.20, the original signal 
and the reconstructed signal are plotted for the case when the signal, Figure 4.15, is 
reconstructed using 224 samples. As the number of samples used for reconstruction 
incresise, the original and the reconstructed signals come closer. The fractional mean 
square error verses the number of samples used for signal reconstruction has been 
plotted in Figure 4.21. 

Example 4.4 The signal analysed in this example is an EMG signal sampled at a rate 
of 2000 samples per second and 240 samples of the signal are shown in Figure 4.22. In 
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Figure label 

Number of samples 

Fractional mean square error 

Figure 5.16 

160 

0.029936 

Figure 5.17 

176 

0.028127 

Figure 5.18 

192 

0.024858 

Figure 5.19 

208 

0.024396 

Figure 5.20 

224 

0.005549 


240 

0.0 


Table 4.3: Error-TV for the original shown in figure 4.15. 



Figure 4.15: The signal analysed in example 4.3. 
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Figure 4.16: The original and the reconstructed signal for compression ratio equal to 
0.6667. The original signal was sampled at 240 points, further only 160 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 




Figure 4.17: The original and the reconstructed signal for compression ratio equal to 
0.7333. The original signal was sampled at 240 points, further only 176 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.18: The original and the reconstructed signal for compression ratio equal to 
0.8000. The original signal was sampled at 240 points, further only 192 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.19: The original and the reconstructed signal for compression ratio equal to 
0.8667. The original signal was sampled at 240 points, further, 208 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.20: The original and the reconstructed signal for compression ratio equal to 
0.9333. The original signal was sampled at 240 points, further, 224 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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Table 4.4, the fractional mean square error for various number of samples is presented. 
The various numbers of samples for which the fractional errors have been tabulated are 
160, 176, 192, 208, 224, 240. For each of the numbers the reconstructed signal and the 
fractional mean square error are obtained. To find the mean square error, the signal is 
reconstructed at the initial set of samples. Then, using the original sample set and the 
reconstructed set the fractional mean square error is found. It can be observed from 
the table, that, the fractional mean square error reduces as the number of samples 
increases. 

In Figure 4.23, the original signal and the reconstructed signal are plotted for the case 
when the signal, shovm in Figure 4.22, is reconstructed using 160 samples. In Figure 
4.24, the original signal and the reconstructed signal are plotted for the case when the 
signal, shown in Figure 4.22 is reconstructed using 176 samples. In Figure 4.25, the 
original signal and the reconstructed signal are plotted for the case when the signal, 
shown in Figure 4.22, is reconstructed using 192 samples. In Figure 4.26, the original 
signal and the reconstructed signal are plotted for the case when the signal, shown 
in Figure 4.22, is reconstructed using 208 samples. In Figure 4.27, the original signal 
and the reconstructed signal are plotted for the case when the signal. Figure 4.22, is 
reconstructed using 224 samples. As the number of samples used for reconstruction 
increase, the original and the reconstructed signals come closer. The fractional mean 
square error verses the number of samples used for signal reconstruction has been 
plotted in Figure 4.28. 
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Figure label Number of samples Fractional mean square error 


Figure 5.13 


Figure 5.24 


Figure 5.25 


Figure 5.26 


Figure 5.27 



0.04919 


0.035941 


0.033553 
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Figure 4.23: The original and the reconstructed signal for compression ratio equal to 
0.6667. The original signal was sampled at 240 points, further only 160 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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0 50 100 150 200 

Figure 4.25; The original and the reconstructed signal for compression ratio equal to 
0.8000. The original signal was sampled at 240 points, further only 192 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.27: The original and the reconstructed signal for compression ratio equal to 
0.9333. The original signal was sampled at 240 points, further, 224 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using the equation for reconstruction suggested in the section 4.1. 
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Figure 4.28: Error-iV for the signal in Figure 4.22. 
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There are time instants in the interpolated signal, when the reconstructed signal has 
sharp deviations from the original signal, this has been caused due to the sharp decay- 
in the exponentials. In the simulation examples given in the chapter, the decaying 
exponentials are used for interpolation. Even piecewdse linear interpolation can be 
used; the simulation result when the piecewise linear interpolation is used for the ECG 
signal given in Example 4.3 is given in the Appendix A. It can be observed from 
the simulations presented in the Appendix A, that piecewise linear interpolation is 
better suited than the interpolation using decaying exponentials under these conditions. 
However more extensive studies are needed to ascertain the combination of the best 
wavelet basis and best interpolation. 


4.4 Conclusions 

In this chapter an algorithm for optimal sample placement for time-limited signals 
is presented. The algorithm utilises the excellent time-scale localisation properties 
of the wavelet transforms. The sampling algorithm developed here is based on the 
observation that if the error in the transformed domain is bounded, then the error in 
.the time domain also gets bounded. 

In section 4.1, the problem attempted in the chapter is formulated. The conditions 
imposed on the type of interpolation also has been discussed. It is assumed that the 
interpolation has been done by functions which are local, further, the interpolation 
is such that the value of the interpolated signal is equal to the sample value at the 
sampling instant. In this chapter, the asymmetric decaying exponentials are used for 
interpolation. The decay of these functions are set, such that, their value is one at the 
sampling instant but at the neighbouring instants it is less than e, where e is set to a 
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very small value. 

In section 4.2, theorems have been presented, which give the bounds on the fractional 
mean square error. It can be inferred from the theorems, that the bound on the frac- 
tional mean square error is relatively more sensitive to the fractional mean square error 
in the transformed domain, at lower scales. Therefore, to make the fractional mean 
square error smaller the error in the transformed domain should be made relatively 
more small at lower scales. Another observation that has been made is that, the frac- 
tional mean square error in the transformed domain can be made small by placing the 
samples at those points in the transformed domain, at which the wavelet transform 
maxima occur. These are the guidelines using which a sampling strategy is developed 
in the section 4.3. 

The algorithm proceeds by first sampling the signal at the highest possible rate, in 
our case we always take 240 samples of the signal, then the multiresolution analysis is 
used to find the wavelet transform of the signal. Then the samples are picked in the 
time domain at a value denoted by t,-, if the wavelet transform attains maximum in 
the transformed domsiin at U. This gives the initial set of samples, if all the maxima 
are exhausted and still samples can be taken then rest of the samples are taken in the 
neighbourhood of the samples in the initial set. Using the optimal samples the original 
set of samples is reconstructed using an interpolation method. Certain conditions on 
the interpolation methods to be used have also been placed. These condition are- 


The interpolation method should be such that, at the known values of the signal 
the interpolated \’alue should come out to be same as the knowm value. 
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• The form of the interpolating function should have the following form- 

9{^) sO'k) hk {t tk,tk—i,tk+i). 

k 

For the first condition to be satisfied we require- 


1 ) ^k^ik—ij^k+i) — 0) for j ^ k. (4.15) 

Simulation results which demonstrate the algorithm have been presented. In the opti- 
mal sampling strategy evolved here the signal to be sampled is initially at the highest 
possible rate, then the required number of samples are picked out of the original set 
of samples. The number of samples to be picked is decided by the compression ratio 
required. 



Chapter 5 


A Region Based Sampling Strategy 
Using Wavelet Transforms 


In the sampling strategy proposed in the previous chapter, the samples fall nonuni- 
formly, therefore all the sampling instants also have to be stored. To eliminate the 
requirement of sampling instant storage, another problem is formulated in this chap- 
ter, in which, the signal is partitioned and sampling rate is varied depending upon the 
local variations. 

In this chapter, a sampling strategy based on the local variations is proposed. The 
problem formulated here consists of distributing a fixed number of samples into vari- 
ous segments depending upon the variations in them. The signals considered here are 
time-limited. The strategy proceeds by first segmenting the signal using the wavelet 
transformed domain description, subsequently sampling in each segment is done de- 
pending upon its scale-limit. It has been established that, under reasonable assump- 
tions, the number of samples in any region is inversely proportional to the scale-limit. 
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This result has been used to develop a region based signal sampling algorithm. 


5.1 Introduction 

As already discussed in Chapter 2, in conventional signal processing, signals are sam- 
pled uniformly at twice the bandwidth[Sha49]. In the absence of any information about 
the bandwidth of the signal, an antialiasing filter is used and sampling is done at the 
Nyquist rate. However, when the estimate of the bandwidth of the antialiasing filter 
is not known then, it becomes very difficult to do sampling. Under these conditions 
arbitrarily high rates of sampling are used. However, both in the event of the availabil- 
ity and non-availability of the information about tlie bandwidth, the sampling is done 
uniformly. In this chapter, an alternative approach to sampling of time-limited signals 
is suggested. Here a sampling strategy is evolved, in which, the rate of sampling adapts 
to the local variations of the signal. This essentially leads to a nonuniform sampling 
problem. 

Attempts of similar kind have been made [SA94],{MGCH88],[BdT88]. Most of these are 
directed towards signal and image compression applications. The problem formulated 
here consists of segmenting a given signal depending upon its local variations and then 
distributing a fixed number of samples optimally, across the segments. In the algorithm 
evolved here, the given signal is segmented depending upon a variation measure called 
scale-limitedness, and then a fixed number of samples are distributed into the partitions 
depending upon their respective scale-limits. 

Scale-limitedness is used as a measure of variation, rather than using band-limitedness, 
because it has the ability to characterise local variations. The concept of scale- 
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limitedness with reference to wavelet transforms has already been initiated in Chapter 
3. Scale-limitedness is defined as the scale value below which the wavelet transform 
coefficients axe zero. In wavelet transform, a signal is decomposed into various scales 
and shifts. The coefficients corresponding to smaller scale values indicate the relatively 
faster varying component present in the signal. Since wavelets have energy concen- 
trated for a finite duration, it is appropriate to use wavelet transforms for analysing 
practical signals (time-limited signals). 

The wavelet transform of a signal is the inner product between the signal and shifted, 
scaled versions of a function called the mother wavelet. In practice, only the samples of 
the signal to be analysed are known. The approximation of the signal can be found by 
passing the sequence through a bank of filters[Mal89]. Algorithms based on this concept 
provide a method of representing a discrete sequence in terms of the wavelet transform 
values at scales 2^' and the corresponding shifts 2^' k. Using the approximation sequence 
at any stage and the transforms (Detail signals) at the previous stages , the original 
sample sequence can be reconstructed. 

Due to the above mentioned scheme, the algorithm for suboptimal sampling developed 
here starts by sampling the incoming signal at an arbitrary high rate, then retaining 
only the required number of samples in each partition. An algorithm for segmenting 
the signal is also presented. 

In section 5.2, the problem has been formulated. In section 5.3, the algorithms for the 
segmenting and sampling are given. The simulation results are given in section 5.4. 
The conclusions are presented in section 5.5. 
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5.2 Problem Statement 


The problem formulated in this chapter is termed as Sample number distribution prob- 
lem. 


Let g{t) be the signal and [0, A] be the interval of the signal. The interval [0, A] is 
partitioned into ‘m’ partitions. Let the partition be denoted by tj), so that 
to = 0 and tm = A. The number of samples in the partition is denoted by n,-. In 
each of the partitions uniform sampling is done. 


The optimal sampling problem considered here consists of finding the sample number 
distribution no,...,nm-i, such that the fractional mean square error between the given 
signal and the reconstructed signal is minimised. Let g{t) and g[t) be the original and 
reconstructed signals; then the optimal sampling problem i.s given by 


mm 


E. 


( 5 . 1 ) 


where Eg is the energy of the signal and given that Yli w'here N is fixed apriori. 


The sampling strateg}’ developed here initially samples the given analog signal at an 
arbitrarily high rate, let the initial set of samples consists of Nq samples. Then a subset 
of this initial sample set is selected such that an error bound between the reconstructed 
signal using this subset and the original signal is minimi.sed. Let the number of samples 
in the subset be TV, then X),- = N. 

A sampling algorithm depends upon the error norm and the interpolation method used. 
The error norm used here is the fractional mean square norm given by 

llgffl -g(^)|P _ Jo Igjt) - g{t)\‘^ dt 

Eg Eg 


( 5 . 2 ) 
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Let the reconstructed signal be 

9{t) = ^ ^ ^ = 

The fractional mean square reconstruction error is given by, 

/o^ \9it)-m\‘^dt _ ZikB, \9{t) - 9rit)\^ dt 


Ea 


da db 
b) - 11 ^,,, (a, 5)P da dh 


( 5 . 4 ) 

( 5 . 5 ) 




m. 5o + Q 


where Q is given by the following quantity, 

^ Ia=a,, ? I W ff.v'- («. b) - (a, 6) p da db 


( 5 . 6 ) 


( 5 . 7 ) 


and a'l^s are the 5o scale-limits in the partitions. 


Near the optimal distribution of the samples Q is taken to be constant. The reason 
is that Q is only a ver}^ small fraction of the overall reconstruction error and can be 
taken to be constant. This statement gets justified in simulations. The higher limit of 
the scale is taken to be a//,, because, in practice, in tlie multirc-solution analysis any 
signal is decomposed only upto a finite number of levels. 

To find a bound on the fractional mean square reconstruction error, an assumption of 
the following kind is made- 

\W,,„{a,b)-W^_,.{a,b)\ C(q) . 5 ^ 

E. - (n.)“’ 

for b 6 Bi- The parameter a is called interpolation sensitivity^ This assumption 
is based on the practical obser\'ation that, as the number of samples in any segment 
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r 


increases the original and the reconstructed signals come close {in the sense of a norm), 
so that the transformed domain descriptions of the original and the reconstructed 
signal also come close. Therefore, the magnitude of the error can be bounded by a 
monotonically decreasing function. This specific form is assumed because it leads to a 
simpler analysis and gives an estimate of the sample distribution which can be realised 
easily in practice. On the right hand side of the inequality 5.8 the numerator is made 
dependent on a, because for different a values, the constant C{a) has to be different, 
so that the assumption 5.8 gets satisfied. 


Under this assumption, the error takes the following form- 


Ea 


< 


r ro-th 
Jan 


C{a) 


da db +m 5o + Q 




i=:l 

Next the following conjecture is made- 


(5.9) 

(5.10) 


Conjecture 5.3.1 The fractional mean square error gets minimised for the same sam- 
ple distribution for which the error bound 5.10 gets minimised. 


Due to this conjecture the optimal sampling problem reduces to finding the values of 
the parameters n,-, i = 0, ...,m — 1 and a for which the error bound gets minimised. 
An optimal solution to the problem can be found by minimising the error bound with 
respect to the rii and a. This error bound function is denoted by e(no, ...,nm-i, <y), 


eK,...,n„..,a) = + C (5.11) 

X=1 

The constraint under which this optimisation is performed is given by 




(5.12) 
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Using Lagrangian multipliers method, the following funct ion has to be optimised- 

(5.13) 


e' (no, n„,-i , a) = £ -7~^ ~ + fl] 


1=1 


(n,)“ au 


Differentiating e'(no,-,^m-i,a) with respect to n,. q and A' independently and equat- 
ing to zero leads to the following equations. 


n. 




A' 




? = 0 m - 1. 




1 ^ 

oi, (n,)« da 

> . 


0 

N 


(5.14) 

(5.15) 

(5.16) 


Solution of this system of (m + 2) equations require.s tlie knowledge of ^C(q). To 
eliminate the Equation 5.15, an assumption on tlie value of a is made. The parameter 
a is assumed to be close to zero. For o = 0, the assumption is valid for g{t) and g{t) 
in I/^. 


Once a is fixed to a value close to zero (we take a— 0.0001 ), tlie n, ’s can be solved using 
Equations 5.14 and 5.16. Then n,’s are used to calculate the fractional mean square 
reconstruction error. 

A problem that arises in the implementation of tlie algorithm is that the optimal 
solution values of rn may not turn out to i>e integers. In that case, a decision regarding 
the choice of the number of samples to be distribut<'d in the d'' partition has to be 
made. The choice could be the smallest integer greater than n, or the largest integer 
smaller than n^. We use the following notation. 

[ui : The highest number less than or equal to n^. 

n,] : The smallest number greater than or equal rr,. 
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If the nis are real, then there are many ways in which the number of samples to be 
distributed in the partition can be approximated. 

Case 1- If all rii are approximated to n.], then the total number of samples that get 
distributed will turn out to be greater than N but less than N -\-m. 

Case 2- If all rii are approximated to [n^ then the total number of samples that get 
distributed will turn out to be less than N but greater than N — m. 

Case 3- Another choice could, however, be to distribute [n,- number of samples in the 
‘ra’ partitions and distribute the remaining (A^ — EiL^i) samples in ‘m’ partitions such 
that at the most one sample falls in one partition. The value of {N — XtL^i) is less 
then or equal to m; let this number be k. There are ^Ck ways in which it can be done. 
This is highly computationally intensive. 

We will shortly see that the approach given in the Case 1 is the best possible alterna- 
tive. The only problem we have in this approach is that the number of samples that get 
distributed is more than N. But there is another practical phenomenon which has an 
opposing effect. In the computation of the wavelet transform of a signal, initially the 
signal is sampled at a high rate and it is assumed that the samples constitute the first 
approximation of the signal. This has been discussed in Chapter 3. The policy for sam- 
ple distribution that we follow is, that firstly in each partition, the samples are placed 
uniformly and secondly the required number of samples are selected out of the samples 
in the first approximation. In the Case 1, the number of samples that are distributed in 
the partition is given by n^] . If n,] turns out to be greater than the number of sam- 
ples in the partition, in the first approximation, then there is a surplus of (n,] — n*), 
where [n* = number of samples in the partition in the first approximation). 
Therefore, due to this factor as well the number of samples that get distributed turn 
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out to be different than than the desired. However, the two problems described above 
have opposing effects. Therefore the approach presented in the Case 1 has been im- 
plemented and the simulation results have been presented. In this case the number of 
samples that finally get distributed comes out to be less than the number of samples 
to be distributed. 


For the practical implementation of the algorithm two issues have to be sorted out. 
The mean square error has to be calculated in terms of the samples of the signals g{t) 
and g{t). The number of these samples depends on the computational ability. Let 
No be the number of samples using which the fractional mean square error is to be 
approximated. Using the piecewise approximation, the fractional mean square error is 


given by- 


ec(no, ...Tim-ua) 


ztoHs{k) - mv 


(5.17) 


where g{kys are the interpolated values using N samples for various sample distribu- 
tions. The interpolating equation used here is already discussed and is given by 5.19. 
Another issue is the implementation of the wavelet transform. Here for calculating the 
wavelet transform, the multiresolution algorithm is applied using the initial Nq number 
of samples as the approximation in the space Uq- Then the wavelet decomposition is 
calculated for a=2, 4, 8, 16. The decomposition for scale values greater than 16 are not 
considered, because they contain insignificant amount of energy, and therefore have 
negligible contribution in deciding the sample distribution. 


5.3.1 Segmentation Strategy 

As already been described, the signal is segmented into regions of different scale-limits. 
For practically doing that a threshold 9 is selected. 
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The strategy that we follow is, to assign a scale-limit of 2^^ to an interval A:22^»], 

for ku k 2 integers, if Wg^^{a, 6) < (9 for a = 2^’, and 6 = k 2 ^, forall j < ji and k is such 
that ki2^^ < k 2 ^ < k 22 ^K This implies that any region is assigned a scale-limit of 2 ^\ 
if for all scales less than or equal to 2^', the wavelet transform is zero or insignificant 
for ‘b’ (the shift parameter) lying in the interval. 

The following algorithm is implemented. For j = 1, the coefficients Wg^^{2^,k2^) are 
compared with a predecided threshold. The value of the threshold has to satisfy the 
following constraint 

0 < ^ < 1 (5.18) 

The value of the threshold has to be taken close to zero. If the value of the coefficient 
Wg^^{2,2k) is greater than the threshold for 2k G Bi, and for k2 G = [0, A] — Bi 
the coefficient is less than the threshold value then the region Bi is assigned a scale- 
limit of 1. Next the value of Wg^^f,(4,4k) is compared with the threshold value. And 
the region B 2 C [0, A] — Bi such that Wg^^{4,4k) > 6 , for 4k 6 B 2 , is assigned 
a scale-limit of 2. Further, a region B 3 C ([0, A] — (Bi U B 2 )) is found such that 
lFg,^(8,8fc) > 9, for 8 k G B3. The region S3 is assigned a scale-limit of 4. Next, 
a region B 4 C ([0, .4] — (Sj U S2 U S3)) is found such that 16k) > 9, for 

16k G S4. The region S4 is assigned a scale-limit of 8. Finally the region S5 given by 
S5 = [0, .4] - (Sj U S2 U S3 U S4) is assigned a scale-limit of 16. 

5.3.2 Interpolation Procedure 

In our derivation it has been assumed that the interpolating function used is scale- 
limited with the same scale value to which the original signal is scale-limited. There- 
fore, our problem is to find a scale-limited interpolating function. Since the functions 
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are scale-limited hence they can be used for interpolation. Where, the 
function ^(t) is the scaling function of the multiresolution analysis used for analysing 
the signal. The interpolation used here has the following form 

g{t) = 9i{t), for t € t,), 

where gi{t) is the reconstruction of the signal in the i*’' region and o;, is the scale-limit 
and Ti = 

TXj 

5.3.3 Algorithm 

In the algorithm presented here, the values of 6 arc varied in ste{)s and for each value, 
the optimal sample distribution is found. Using tins distribution, the signal is recon- 
structed and the mean square error is calculated. Finally the sample distribution is 
selected for which the mean square error is minimum. The final algorithm has the 
following steps- Begin 

Step 1: Choose the maximum number of iterations=it„,ax- 
Choose the increment in 9 = A 9. 

Step 2: Choose 9 = 9o, N and No- 
Step 3: Number of the iteration=0. 

Step 4: Sample the given analog signal at Nq number of points. 

Step 5: Apply the multiresolution algorithm and calculate the decomposition of the 
signal into j=l, 2, 3, 4. 
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Step 6: Use the Wg^^{2\ k2^), j=l, 2, 3, 4, to segment the signal and note down the 
scale-limits of the segments. 

Step 7: Calculate the number of samples in each segment using 5.14 and 5.16. 

Step 8: Reconstruct the original iVo samples using the calculated samples in the 
previous step. 

Step 9: Find the mean square reconstruction error using 5.17. 

Step 10: 6 = 9 + A 6 

Number of iterations = Number of iterations 1. 

Step 11: If the Number of iterations is equal to itmax, then select the optimal sample 
distribution and store the samples obtained by sampling the signal with optimal rij 
points in the i^^ segment for i = 0, ..., m — 1. Else go to step 6. 

Step 12: Stop 

End 


5.4 Simulation Results and Discussion 

The algorithm has been tested on various signals. The original and the reconstructed 
signals for various a values have been plotted. The mean square reconstruction error 
has been plotted with respect to a. 

As a measure of the compression obtained, the following compression measure is 
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defined- 


Compression ratio 


Final ninnher of the samples 
Initial nnmher of the samples 


or, 


Compression ratio 


N 

1 % 


( 5 . 20 ) 


In the simulation results which are presented here, three test signals- gi{t), g 2 {t) and 
c/ 3 (t), are considered. These signals are segmented and then sampled using the algo- 
rithm presented in the previous section; the sample.^ are again reused to reconstruct 
the original signal. The test signal giif) and its reconstructed version are plotted in 
Figure 5.1. The signal is segmented l)y u.sing various fl and then reconstructed using 
the reconstruction equation given in 5. 19. To find tlie optimal the error between the 
original and the reconstructed signal are plott ed for various $. And that value of 9 is 
picked, for which, the mean square error is minimum. The interpolation sensitivity in 
the transformed domain is taken to be 0.0001. The optimal 9 obtained is 0.005 and 
the minimum mean square fractional error is given by 0.136929. 


In Figure 5.2, the segmentation of the signal ol)tained for optimal 6 is plotted along 
with the original signal. It can be observed that fasten varying regions have relatively 
smaller scale-limits. In Figure 5.3, the fractional iiKuin .square error is plotted with 
respect to 9. The mean square error with resjx'ct to 0 is tabulated in Table 5.1. The 
compression ratio obtained for optimal 9 is 0.G20833. In this simulation, initially 180 
samples were to be distributed in the segments, hence the expected compression ratio 
was 0.75, however, the compression ratio obtained is 0.620833, this compression ratio 
is less than the expected compression. The reason for this behaviour has already been 
discussed earlier. 
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In a certain segment if the number of the samples distributed using the algorithm 
is more than the number of samples in the original signal in that segment, then the 
number of samples allocated to that segment is taken to be the number of samples, in 
the original signal, in that segment. This practical step has been taken because in the 
first step, the original signal is replaced by its samples and it is assumed that there is 
no information loss in this step. Therefore, the final number of samples to be picked up 
from a segment should not be more than the original number of samples present in the 
signal in that segment. The segmentation of the signal has also been optimised with 
respect to the parameter Q. In other words, that value of the parameter B is chosen for 
which the fractional mean square error is minimum. The optimal number of partitions 
for the test signal gi{t) is 24. 

Similarly, the test signal 52 (i) and its reconstruction is plotted in Figure 5.4. The 
segmentation obtained for the optimal 6 is plotted in Figure 5.5. In this case as well, 
the faster varying regions have relatively smaller scale-limits. The fractional mean 
square error with respect to B is plotted in Figure 5.6. For this test signal, the optimal 
mean square error obtained is 0.149621. The optimal 6 is 0.05. The optimal number 
of segments is 15. The final compression ratio obtained is 0.679166. 

For the test signal 53 (t), there are two optimal 6 values. The first optimum is for 
the local minimum in the fractional mean square error versus B plot and the second 
optimum is for the global minimum. For the local minimum, the test signal g 3 {t) and 
its reconstruction is plotted in Figure 5.7. For the global minimum, the test signal 
p3(t) and its reconstruction is plotted in Figure 5.8. The segmentation obtained for 
the optimal B is plotted in Figure 5.9. In this case also the faster varying regions have 
relatively smaller scale-limits. The fractional mean square error with respect to B is 
plotted in Figure 5.10. The mean square error with respect to B is tabulated in Table 
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5.2. 

For the local minimum, for the test signal gsit), the optimal fractional mean squaie 
error obtained is 0.0007313. The optimal 9 is 0.001 and the optimal number of segments 
is 18. The final compression ratio obtained is 0.700000. 

For the global minimum, the optimal fractional mean square error obtained is 0.000037. 
The optimal 9 is 1.0. The optimal number of segments is 1. The final compression 
ratio obtained is 0.745833. The mean square error with respect to 9 is tabulated in 
Table 5.3. 

From the simulation results, it can be observed that, tlu' concept scale-limitedness can 
be used for partitioning the signal. The mean stpiare error plotted with respect to 0 
shows many local minima, therefore, it becomes very difficult to find out, upto which 
value of 9 the simulations have to be performed. However, within the range of 6 tested 
in each example, the optimal fractional mean square error obtained is appreciably low. 
And also the signal reconstructed after partitioning and sampling using the optimal 0 
also matches the original signal. 
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Figure 5.1: The signal gi{t) and the reconstructed signal gi{t) 
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5.4 Simulation Results and Discussion 
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Figure 5.4: The .signal g 2 {t) and the reron.structed signal 





5.4 Simulation Results and Discussion 


169 



0 40 80 120 160 200 240 


t 


Figure 5.5: The signal g 2 {t) and the the partitioning obtained using the optimal choice 
of e. 
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5.4 Simulation Results and Discussion 
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9 

Fractional 

Mean square error 

Number of 

Partitions 

Compression ratio 

"o.oooi 

0.263028 

4 

0.733333 

0.0009 

0.034760 

13 

0.683333 

0.001 

0.032267 

13 

0.683333 

0.002 

0.027355 

25 

0.662500 

0.005 

0.136929 

24 

0.620833 

0.01 

0.220440 

17 

0.558333 

0.1 

2.552180 

25 

0.491667 

1.0 

1.845670 

12 

0.329167 

10.0 

1.607650 

1 

0.750000 


Table 5.1: For the signal gi{t), the Fractional mean square error, number of partitions 
and the compression ratio along with the various values of 9 are presented in this table. 

5.5 Conclusions 


The problem that has been addressed, consists of distributing a fixed number of samples 
optimally in the different regions of a signal. The regions are obtained by partitioning 
the signal depending upon local variations. In the sampling strategy, proposed here, 
the rate of sampling adapts to local variations. In the algorithm for sampling, pro- 
posed here, first the signal is partitioned into dissimilar regions. Each of the regions 
is characterised by a scale-limit, which is distinct from the values of the scale-limits 
of the neighbouring regions. Then, in each region the optimal number of samples are 
distributed, which is a fraction of the total number of samples to be distributed. This 
distribution is done according to the Equation 5.14. 

In section 5.2, the problem has been formulated. The problem consists of distributing 
a fixed number of samples optimally into the partitions of a signal. Here the fractional 
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e 

Fractional 

Mean square error 

Number of 

Partitions 

Conq're.ssion rati(> 

0.0001 

0.245450 

2 

0.74.58.33 

0.001 

0.245450 

2 

0.7458.33 

0.005 

0.155359 

4 

0.733333 

0.01 

0.242324 

8 

0.7041668 

0.03 

1.058120 

11 

0.691667 

0.05 

0.149621 

15 

^ 0.679166 

0.07 

3.736660 

16 

0.675000 

0.1 

1.043800 

23 

0.666666 

0.5 

0.153883 

19 

0.379167 

1.0 

0.254654 

6 

0.337500 

10.0 

0.235071 

1 

0.750000 


Table 5.2: For the signal .g-iCOi the Fractional mean stjnarc ('rror, number of partitions 
and the compression ratio along with the various values of 0 are presented in this table. 


6 

Fractional 

Mean square error 

Number of 

Partitions 

Compe.ssion ratio 

0.0001 

0.008219 

8 

0.720.^33 

0.001 

0.000731 

11 

().7n{){)00 

0.005 

0.001596 

14 

{).G375(>0 

0.01 

^0.005000 

18 

0.5708.33 

0.1 

0.183720 

13 

0.450000 

1.0 

0.000037 

1 

0.750000 


Table 5.3: For the signal gz{t), the Fractional mean square error, number of partitions 
and the compression ratio along with the various values of 0 are presented in this table. 






5.5 Conclusions 


177 


mean square error is minimised by taking the number of samples in each partition as 
variables. The interpolation is done using functions which are scale-limited. 

The segmentation and sampling algorithms have been presented in section 5.3. It has 
been proved that segments with smaller scale-limits should be sampled at a higher 
sampling rate. To segment the signal a threshold value is selected first. Next, regions 
of h are marked out, wherein, the wavelet transform value for scale value equal to 2 is 
more then the threshold. The segment which is common to both this region and the 
domain of the signal is assigned a scale-limit of 1. Next the regions which are left over 
have to be classified. The regions which are common to the left over regions and the 
regions of the shift parameter, wherein, the wavelet transform value for scale value 2 
is less than the threshold and the wavelet transform value for scale 4 is greater than 
the threshold value are assigned a scale-limit of 2. Similarly, any region is assigned a 
scale-limit of 2^, if the wavelet transform value for the scale in this region and the for 
all shifts less than equal to 2^ is less than the threshold. 

The algorithm proposed for optimal sampling is as follows. First a low value of the 
threshold is set, then the optimal sample distribution is found, using this optimal 
distribution the signal is sampled uniformly in the different segments. Next these 
samples are used to reconstruct the signal back and finally the fractional mean square 
error is found. This is repeated for successively higher values of the threshold and that 
sample distribution is selected, for which, the minimum fractional mean square error 
is obtained. The fractional mean square error verses 6 is found to have many local 
minima, in general, therefore, the global minimum has to be selected. The simulation 
results have been presented in section 4. The conclusion of this chapter is that, in order 
to keep the bound on the fractional mean square error low, the number of samples in 
any segment should be inversely proportional a positive power of the scale-limit. 
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Optimal sample distribution algorithm proposed in this chapter can also be used for 
optimal nonuniform sampling. This is possible when the number of samples to be 
optimally distributed in the partitions turn out to be equal to the number of partitions 

In the examples considered in this chapter the maximum number of partitions are not 
very high, therefore the optimal sample placement, described in the Chapter 4, cannot 
be done. To increase the number of partitions, the signal has to be partitioned into 
more number of scales. For doing that, the signal has to be decomposed into scales 
which fall between the diadics. 



Chapter 6 


Conclusions 


The conventional approach of collecting samples of an analog signal at uniform intervals 
is known as uniform sampling. The uniform sampling approach is not necessarily the 
best or computationally most efficient. In contrast, collecting samples of an analog 
signal at nonuniform intervals is often more rational and optimal in the case of many 
practical signals. Consistent with the type of the signal, which is the best way to take 
the samples or at what intervals the samples are to be taken so that the whole process 
is efficient (requires least number of samples to represent an analog signal), may be 
termed as the basic problem of nonuniform sampling. The objective of this thesis is to 
make a contribution to the above described problem of nonuniform sampling. 


6.1 Summary and Conclusions 


In conventional signal processing, signals are sampled uniformly. This is based on 
Shannon’s sampling theorem. In uniform sampling the signal is sampled at a rate 
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equal to the twice of the bandwidth. This technique is not suitable for the following 
cases- (a) When the signal is not band-limited, (2) When an estimate of the bandwidth 
of the signal is not a%-ailable. It is for these cases the nonuniform sampling can serve 
as an alternative. In this thesis, two nonuniform sampling problems for time-limited 
signals have been formulated. In the first proifiem, a finite number of samples are 
placed in the domain of the signal such that the fractional mean square reconstruction 
error is minimised. Here the fractional mean square error is the ratio of the mean square 
error to the energ}' of the original signal. In the second problem, a finite number of 
samples are distributed optimally in the partitions of a time-limited signal. 

In the first problem, a finite number of .samples are distributed in the domain of the 
signal such that the fractional mean square reconstruction error is minimised. In 
Chapter 4 this problem has been analysed and simulation results are i)resented. It 
has been shown that if the interpolation is done using functions which are shifted to 
sample point and multiplied by the sample value and further these functions are local 
(Most of the energy is concentrated around the origin.), then, tlie samples should fall 
in the same regions, in which, the wavelet transform values are relatively large in the 
domain of the shift parameter. Another constraint on the sample point is that it should 
be in the domain of the original signal. Using the al)ove nuuitionc'd properties of the 
optimal sampling instants, an algorithm for oj>timal .sam})ling has bec'ii proposed. 

In the case of the problem proposed in Chai)ter 4 t he samples fall nonuniformly, there- 
fore all the sampling instants also have to be stored. To (dirninate the requirement of 
sampling instant storage, another problem is formulated, in wliich, the signal is par- 
titioned and sampling rate is varied depending upon the local variations. This is the 
second problem attempted in this thesis. 
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In the second problem, which has been formulated in Chapter 5, a finite number of 
samples are distributed optimally in the partitions of a signal such that the fractional 
mean square reconstruction error is minimised. It is assumed that in each of the parti- 
tions the samples are distributed uniformly and reconstruction is done using functions 
which are scale-limited. Under these conditions it has been shown that, the optimal 
number of samples in a partition is inversely proportional to a positive power of the 
scale-limit of the partition. To partition the signal into dissimilar regions, a new^ con- 
cept of scale-limitedness is introduced and utilised. The algorithm for sampling and 
the simulations results are also presented in the same chapter. 

In Chapter 3, the concept of scale-limitedness with reference to wavelet transforms has 
been introduced. This concept has been used to characterise variations in a signal. 
A signal is said to be scale-imited to a certain value if the wavelet transform is zero 
for the scale parameter below that value and for all shifts. It has been shown through 
simulations that signals with smaller scale-limits are faster varying. In the same chapter 
it has been shown that, for the same reconstruction error, signals with smaller scale- 
limits should be sampled at a relatively faster rate. 

It is important to note, that the approach of nonuniform sampling followed in Chapter 
5 is similar to subband coding of speech signals. In subband coding proposed by 
Crochiere et. al. [Cro77], the speech signal is partitioned in frequency domain into 
subbands and then encoding the bands are individually done. In subband coding, at 
lower bands, where pitch and formant structure must be accurately preserved, a larger 
number of bits per sample are used for encoding, w'hereas in upper bands noise-like 
sounds occur in speech, fewmr bits per sample are used. In our approach, the incoming 
signal is partitioned in the time domain itself and the rate of sampling in each partition 
is varied depending upon the scale-limit of each partition. To summerise these are the 
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conclusions of this thesis. 

• The concept of scale-limitedness can be used for characterisation of signal varia- 
tions. Scale-limited signals have the following properties- 

- A band-limited signal is also scale-limited with respect to a certain wavelet 
family. 

- The differential is inversely proportional to the power of the scale- 
limit of the signal. 

- There exist time-limited signals which are scale-limited jis well. 

- The Lagrangian interpolating function is scale-limited. 

- A signal in Vj is scale-limited to 2-^, where, is space iussociated to the 
multiresolution analysis. 

It has been shown through simulations that signals with smaller scale-limits are 
faster varying. Further it has been shown that signals with smaller scale-limits 
should be sampled at a relatively faster rate for the same reconstruction error. 

• If a signal is partitioned into regions of difh'rent .scale-limits, then regions with 
smaller scale-limits should be sampled at a rtdativt'ly higher rate to minimise the 
overall fractional mean square reconstruction furor. The reconstruction in any 
partition is done using functions which are .sfuile-limited to the scale-limit of the 
partition. 

• The optimal nonuniform sampling strategy' is one in which, the samples are placed 
in regions, in which, the wavelet transform has relatively large magnitude with 
respect to the shift parameter over different scales. It has been assumed that the 
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reconstruction is done using local functions. Using this result, an algorithm for 
nonuniform sampling of a finite duration signal is proposed. 


6.2 Scope for Future Work 

The possible directions for future work are as follows. 

• This thesis has proposed novel techniques for optimal sampling of time-limited 
signals. The signals considered are one dimensional, however, the theory proposed 
here can be applied for higher dimensional signals. For example, this theory can 
be reformulated for images and images can be nonuniformly sampled. 

• In the case of region based sampling strategy proposed in the thesis, for segment- 
ing the signal, same threshold values have been used for all scales, however, the 
performance of the algorithm can be studied for case when different threshold 
values are used for different scales. 

• The processing of nonuniform samples also has to be thoroughly studied. There 
has been some work done in the area of spectral estimation and system identifica- 
tion using nonuniform samples [Sir87], [SS88], however, there are many subfields 
of processing, in whicli work has to be done. For example, filtering of nonuniform 
samples and interpolation of signals using nonuniform samples. 

• Using the algorithm for region based sampling proposed in Chapter 5, optimal 
nonuniform sampling discussed in Chapter 4 can be done. For doing that, the 
number of partitions should be equal to the number of samples to be distributed. 
To increase the number of partitions, there can be two ways- one is to increase 
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the number of scales into which the signal is partitioned and another way is to 
have different threshold values for different scales. 

• In this thesis, only 8'^’ wavelets are used, however the same algorithms can be 
tried out with other wavelets and the w’avelet basis which gives the minimum 
reconstruction error can be found out. Similarly, different interpolation methods 
can also be tried out and the best interpolation method can be ascertained 



Appendix A- Simulation results 
when linear interpolation is used 
for ECG signals 


First we show that linear interpolation also falls in the class of interpolations, in which, 
the interpolation is done in terms of local functions and the samples. Because the theory 
developed in the Chapter 4 is applicable only for the case when interpolation is done 
using shifted local functions. ■ 


For linear interpolation hk{t, tk-i, tk+i) takes the following form. 




0, t <C tk—\ 

0, t > tk-kl 


(7.1) 


Example The signal analysed in this example is an ECG signal sampled at a rate of 
200 samples per second and the 240 samples of this signal cire shown in Figure 4.15. In 
Table 7.1, the fractional mean square error for various number of samples is presented. 
The various numbers of samples for which the fractional errors have been tabulated are 
160, 176, 192, 208, 224, 240. For each of the numbers the reconstructed signal and the 
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fractional mean square error are obtained. To find tlie tm'an square error, the signal is 
reconstructed at the initial set of samples. Then, usinj* the original sample set and the 
reconstructed set the fractional mean square error is found. It can be observed from 
the table, that, the fractional mean square error reduces as the number of samples 
increases. 

In Figure 7.1, the original signal and the reconstructed signal are plotted for the case 
when the signal, shown in Figure 4.15, is reconstructed using 160 samples. In Figure 
7.2, the original signal and the reconstructed signal are plotted for the case when the 
signal, shown in Figure 4.15 is reconstructed using 176 samples. In Figure 7.3, the 
original signal and the reconstructed signal are plotted for the r;isp when the signal, 
shown in Figure 4.15, is reconstructed usitig 102 .‘amples, In Figure 7.4, the original 
signal and the reconstructed signal are plott ed for t he ca.se when t.lic signal, shown 
in Figure 4.15, is reconstructed using 208 sampit'S. In Figure 7.5, the original signal 
and the reconstructed signal are plotted fo/ the ca.se when the signal, Figure 4.15, is 
reconstructed using 224 samples. As the number of samples used for reconstruction 
increase, the original and the reconstructed signals come closer. The fractional mean 
square error verses the number of samples used for signal reconstruction has been 
plotted in Figure 7.6. 

From the simulation results, it. can l)e oliserved that, the linear interpolation can also 
be used. 
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Figure label 

Number of samples 

fractional mean square error 

Figure 0.1 

160 

0.021332 

Figure 0.2 

176 

0.019385 

Figure 0.3 

192 

0.018330 

Figure 0.4 

208 

0.017669 

Figure 0.5 

224 

0.004882 


240 

0.000000 


Table 7.1: Error- TV for the original shown in figure 4.15. 



Figure 7.1: The original and the reconstructed signal for compression ratio equal to 
0.6667. The original signal was sampled at 240 points, further only 160 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using linear interpolation. 
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Onginaf Signal 
Reconstnjctecl Signal 


Figure 7.2: The original and the reconstructed signal for compression ratio equal to 
0.7333. The original signal was sampled at 240 points, further only 176 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using linear interpolation. 
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•Figure 7.3; The original and the reconstructed signal for compression ratio equal to 
0.8000. The original signal was sampled at 240 points, further only 192 samples are 
retained at nonuniform sampling instants and the signal is reconstructed at the initial 
240 instants using linear interpolation. 
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Figure 7.4: The original and the reconstructed signal for compression ratio equal to 
0.8667. The original signal was sampled at 240 points, further, 208 points are retained 
at nonuniform sampling instants and the signal is reconstructed at the initial 240 
instants using linear interpolation. 
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Figure 7.6: Error-A'’ for the signal in Figure 4.15. 
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